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ON ADDITIVITY IN THE ANALYSIS OF VARIANCE’ 


R. C. ELston 


Department of Biostatistics, University of North Carolina 
Chapel Hill, North Carolina, U.S. A. 


INTRODUCTION 


The problem relating to additivity in the analysis of variance is 
twofold. In the first place we wish to know whether we can remove 
any of the non-additivity present in our data, and in the second place 
we wish to know, given that it can be done, how to do so. Here two 
methods that have already been proposed for testing for non-additivity 
are developed from a somewhat different viewpoint, in an attempt to 
clarify their properties; and a generalization is given of a method that 
has been suggested for finding an appropriate transformation of the data. 


TESTING FOR REMOVABLE NON-ADDITIVITY 


Definition. If u;; is the subclass mean corresponding to the i-th 
level of A and to the j-th level of B in any 2-way classification, then 
we shall say that A and B are additive (or the y;; show additivity) 
if and only if there exist constants a; , 8; such that 


Mis = a; + B;, all 7, 7. 


For an n-way classification, denote the subclass means by p», , where q 
is an n-tuple of numbers designating the particular subclass; then there 


is additivity if and only if there exist constants a;, , 8:,, °°: , ¥, Such 
that 
Mg = = +>: +. ; all 1, 


Now whether or not the u, show additivity depends on the scale 
on which they are measured. In practice we measure our data on any 
scale that happens to be convenient, and from these measurements 
estimate the u, ; and, unless we transform the data, we are estimating 
the u, as measured on the same scale as that on which the data are 
measured. But, in many cases, the estimates we obtain are of far 
greater value to us if we can assume that the u, show additivity. Thus, 


1Supported in part by departmental fellowship funds provided by U. S. Public Health Service. 
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if we analyze a set of data y, and find we have to reject the hypothesis 
that the corresponding », show additivity, we should try and find a 
transformation of y, to x, such that the E(r,) show additivity (where 
denotes expectation). Since the y, are measured on a continuous scale, 
it is reasonable to consider only continuous functions of the y, , and 
for such a transformation to be of any practical use it must be a single- 
valued function. With the additional reasonable requirement that the 
inverse function also be single-valued, this is equivalent to requiring 
the function (or its inverse) to be strictly monotonic. 

From here on the symbol yu, will be used to denote subclass means 
measured on a scale on which they show additivity, and we shall denote 
by y, the data measured on any convenient scale. Suppose there exists 
a scale such that when the data are measured on it, and we denote 
these measurements by 2, , 


E(x.) = u+u, (where u is any constant). (1) 


Then the E(z,) show additivity. Furthermore, there is no loss of 
generality when we assume 


max uw, + min yz, = 0, max p, > 0, min p, < 0. (2) 


(We assume x, lies within a definite range, determined by the extent 
of our data.) 
If E(y,) is a linear function of E(x,), then the E(y,) show additivity. 
If E(y,) is a non-linear function of E(x,), then we can approximate 
this function by a quadratic polynomial, i.e. 
E(y,) = @ + a,E(x,) + (3) 
If E(y,) is better approximated by such a quadratic polynomial than 
by any linear polynomial in E(z,), then, provided our data lie within 
the range where this quadratic polynomial is strictly monotonic, there 
exists a single-valued function such that, when applied to the data, 
the expectations of the transformed data come nearer to satisfying 
the condition for additivity. 
Assuming exact equality in (3) and using (1) we may rewrite it as 
a polynomial in yp, , say 
= a+ bu, + cu, (4) 
Differentiating with respect to nu, we obtain b + 2cu, , and here there 
is @ maximum or minimum. Thus E(y,) will be strictly monotonic 
over the two ranges 


(i) b + 2c min p, > 0 
and 


(ii) b + 2c max pn, < 0. 


5. 
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Now using (2) it follows that if max u, — min p, < b/|c |, (i) is satisfied; 
and if max un, — min un, < —b/| c |, (ii) is satisfied (and in this case 
we must have b < 0). 

It is clear from this that there is no point in considering the case 


= 0, and so we can arbitrarily let b = 1 (i.e. divide our model through 
by b) and rewrite (4): 


E(y,) Ma + cu; 


where » and ¢ are appropriately redefined; and this is a strictly mono- 
tonic function over the range 


max uw, — minyu, < (5) 


What we wish to do, then, is to assume a model of this form with 
the y, normally and independently distributed, and test the null hy- 
pothesis that c = 0. If we reject this hypothesis, then, provided (5) 
holds, there exists a monotonic function of the data (whose inverse 
is a quadratic polynomial) that will bring us closer to additivity. In 
order to test this hypothesis we should like to find the reduction in 
sum of squares R(1) due to fitting the model under the null hypothesis, 


and the reduction, R(II), due to fitting the full model. These reductions 
are given by 


and 


where the summations are over all observations, and u, wu, and c are 
estimated from the data. We can find R(I) in the usual way; but 


when we set up the normal equations to find R(II), we obtain a set. 
of cubic equations that are not easy to solve. 

The problem can be simplified, and an approximate solution ob- 
tained, as follows. For the sake of clarity consider the 2-way classi- 


fication, one observation per subclass. Under the null hypothesis 
c = 0 we have 


=uta,t+8;, 
and otherwise 
(Il) = uta; +6; + 


Now the only extra term in the right hand side of (II) that depends 
on both 7 and j is the term 2ca,8; , and it is only if the absolute magni- 


} 
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tude of this term is ever large that (II) can lead to a significantly smaller 
residual sum of squares than (I). We may therefore (neglecting the 
coefficient 2) consider the approximately equivalent model, (II’), given 
by 
E(y;;) = w+ a; + B; + ca; ; (6) 

i.e. we assume a; = a; + ca; and 8; = 8; + c@; , and this is reasonable 
when we remember that c must satisfy (5) for monotonicity. 

In order to obtain R(II’), the reduction in sum of squares due to 
fitting the model (6), it is necessary to minimize >>;; (y:;; — uw — a; — 
8; — ca,8;)”, which results in the following normal equations: 


Lata +8, + 646.) Vii (7) 
Lat & + 8; + + 43) = + 
4, +B + + a.) = + 
LG +a + 8; + = , 


where fi, &; , 8; are a set of values for u, a, , 8; that minimize the above 
sum of squares. If we let >>; @; = >-; 8; = 0, we obtain 


Di, (8) 


= — — + + (10) 
é= (a:8,)°. (11) 


We can obtain.a directly from (8), but &, , 8; and ¢ have to be obtained 
by iteration. We first calculate &; and 8; from (9) and (10) assuming 

= 0, and then, using these values of &; and 8; , we calculate ,é, a 
first approximation to é, from (11). Then assuming é = ,é we recalcu- 
late &; and 8; from (9) and (10), and use these new values to obtain 
a second approximation to é from (11). The process is continued until 
all the estimates become stable. R(II’) is then given by 


Yii — (Yi; B; 68,8;)° 


when >>; &; = >; 8; = 0 and the estimates are such that this reduction 
is maximum. 


1] 
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This method of solution was given by Ward and Dick [1952], but 
they considered the model (6) for a different reason; they wished to 
test the appropriateness of a multiplicative model of the form 

E(yi;) = + + Bi) = + + + a8; , 
and this led them to assume the model (6). They state that the F-test 
for c is only approximate. If we assume as our full model 
Yi = eta; + B; + co,B; + , 
where the ¢;; are independent and N(0, o*), then to test the null hy- 
pothesis that c = 0 we could take as our statistic 
R(II’) — 
— — 1)’ 


where there would have been n degrees of freedom associated with 
the residual sum of squares if the model did not include the term ca,8; . 
But whether or not this statistic actually does follow the F-distribution 
on 1 and (n — 1) degrees of freedom under the null hypothesis requires 
further investigation. 


Now consider the sum of squares due to ,¢, the first approximation 
to é, which is given by 


R(II’’) — = Vii — (y;; — & — B; — 


where ji, &; and 8; are values of a, &; and ; satisfying (7), (9) and (10) 
when é = 0, i.e. we have 


= +B; + &; (18) 
where Dr é; is @ minimum. Now from (11) we have ,é = 


Using this and (13), and letting 0; = 
>: 8; = 0, we find from (12), 


iz. iz. 


From this it is seen that the sum of squares due to ,é is just the sum of 
squares proposed by Tukey [1949a] to test for non-additivity; the 
general formula given by Tukey [1955] is easily shown to be identical 


a 
ij 


~ 
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with the above for a two-way classification when )>; a; = >>; 8; = 0. 
Thus in Tukey’s test for non-additivity we assume the model (II’’) 


= ata, + B + 
€;; independent, N(0, o*), where cla;,8,];; indicates that the term is 
part of the interaction. This is to be interpreted as follows. We let 
=~wta, +6; + (a) ;; 


where >>; (a8);; = 0 forall jand >>; (e8);; = Ofor alli. This uniquely 
defines » + a; + 8; as population parameters, but not a; or 6; . 
Now for any set of a; and 6; that are consistent with this definition let 


a,B; = af + Bi + (af); 


where >>; (a8); = 0 for all j and >>; (a8)’, = 0 for all 7. Then this 
uniquely defines (a8)/; , and this is what is represented above by [a,8;];; . 
The parameter c in model (II”’) can be thought of as the regression of the 
interaction effect (a8);; on the product of the main effects. We then 
test the null hypothesis that c = 0 using the statistic 


— RQ) 
[> yi; — 1) 


(14) 


Now since the y;; are normally and independently distributed with 
variance R(II’’) — is distributed, for fixed @; and 8; , as 
on 1 degree of freedom; and under the null hypothesis this is a central 
x’-distribution, for then E(é;;) = 0. Also, since the distribution is the 
same for all fixed &; and §; , this is in fact the marginal distribution of 
R(II”) — R(1) as obtained from the joint distribution of &; , 6; and 
R(IL”) — R(1), as was pointed out by Tukey. Furthermore, >>;; y?; — 
RII") = — [R(II’”) — can be shown to be independently 
distributed as o”x’ on (n — 1) degrees of freedom, n being the number of 
degrees of freedom associated with Dui é;; . This shows that (14) 
follows an F-distribution on 1 and (n — 1) degrees of freedom.” 
Hamaker [1955] has given an example showing that the sum of 
squares due to é¢ is more effective than the sum of squares due to ,é in 
accounting for non-additivity. But Tukey’s test has the advantage of 
being computationally simpler and of resulting in a test statistic that 
is known to follow the F-distribution. It should be noted that for this 
test we have to assume a model that allows for no interaction effect 
other than can be accounted for by a term c[la,8;];; . This is better 


2A more complete proof of this is given on p. 132 of H. Scheffé’s book “The Analysis of Variance”’ 
[Wiley, 1959}. Scheffé also gives another motivation for Tukey’s test; this came to the author's notice 
after the present paper was written. 
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than assuming a model that allows for no interaction at all, but not 
as good as we might wish. If we have more than one observation per 
subclass, we can assume the more reasonable model 


= + B; + + , 
€:;, independent, N(0, a’), and (a8);; = cla:8;]i; + (a); 
and test the null hypothesis that c = 0, i.e. that 
= +a; + (a8); 
(a8),;; being that part of the interaction effect that cannot be accounted 
for by a term cla;8;];; . Then we can use the test statistic (assuming 


that there are n degrees of freedom associated with the within subclass 
sum of squares) 


— RU) 


f= (within subclass s.s.)/n 


this follows the F-distribution on 1 and n degrees of freedom under the 
null hypothesis, and, if condition (s) hold, provides an approximate 
test of whether the interaction sum of squares can be significantly 
reduced by a transformation of the data (using a monotonic function 
whose inverse is a quadratic polynomial). 

The above can be easily generalized. For example, if we have a 
three-way classification, one observation per subclass, (6) becomes 
= +B + + + arn + Biv); 

using an obvious notation. The sum of squares due to ,é is then 
D> (QB; + + 

provided >>; &; = : 8; = >. % = 0. If there is more than one 
observation per subclass, the summations are extended over all observa- 
tions in each subclass. 

When there are unequal subclass numbers, it is often inconvenient 
computationally to use the restriction that the class effects should sum 
to zero (this is especially the case when a large body of data is being 
analyzed with the aid of an electronic computer). Analogous to equa- 


tion (11) we can find, for the two-way classification, the restriction- 
free formula 


[a,8;);; 
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the summations being over all observations. Substituting this value 
into the equation obtained from (12) on replacing 4:8; by [4&8;];; 
(and allowing for more than one observation per subclass), we obtain 


the summations again being over all observations. The denominator 
in this expression is that part of >> (@,8,)* that is due to an interaction 
effect; it is conveniently obtained in a way analogous to that by which 


the interaction sum of squares of the y;;, is obtained, but with the 
variable &,8; replacing y,;, for all k. 


FINDING AN APPROPRIATE TRANSFORMATION FOR ADDITIVITY 


Consider, as a function of », , E(y,.) =u+tu tem. Ife > 0, 
this is a convex function, while, if c < 0, this is a concave function. 
Also, the inverse function given by 


we = {-1 + V1 — 4cl(u — Ey,)]}/2c, (15) 
is conversely (where it is real-valued) concave if ¢ > O and convex 
ife < 0. 

Note that we can write the inverse function (15) 


Lug) [(E(y.) + (1/4¢) 


where L(u,) is a linear function of u,. This would suggest that, if we 
reject the hypothesis that c = 0, a transformation that might be ex- 
pected to bring our data closer to additivity is the transformation 
xz = (y + k)’” where y is the observed value and k is estimated by 
1/4é — f. However, in view of the fact that the inverse of model (II’) 
(exemplified by equation (6) for the 2-way classification) is slightly 
different from (15), and that in any case such a model is unlikely to 
offer the best fit to the data, attention should not be restricted to this 
transformation alone. Tukey [1949a] suggests that we empirically 
seek out the best transformation in the class x = (y + k)”, choosing 
p <1if ,¢ > 0, and p > 1 [or trying x = log (y + &)] if 
,¢ <0. This advice regarding the choice of p follows from the fact that 
just as (15) is concave or convex according as c > 0 orc < Q, 
so x = (y + k)’ is concave or convex according as p < lor p> 1. 
It is further suggested here that values of k approximating (4 | ,¢|)~?? — a 
be tried first, since this is a solution to 


[E(y.) + (1/4:¢) — = [E(y.) + 


when L(y.) is replaced by @. However, it has been found empirically, 
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from some artificially constructed examples, that this method of choos- 
ing k should only be used as a rough guide. 

Now suppose we have two different transformations each of which 
we think may help in obtaining additivity. (l’or example, we might 
have two choices of p and k for the above general class of transforma- 
tions; or we might have another entirely different transformation sug- 
gested by the nature of the data.) Then we might reasonably try and 


find the best linear combination of these two, i.e. a transformation of 
the form 


t= d,f,(y) + def.(y), 


where f, and f. are the two given functions and d, and d, are unknown 
coefficients. Tukey [1949b] has given a procedure for choosing d,/do. 
His method can be extended to combine linearly more than two func- 
tions of the data, and the general method of obtaining suitable co- 
efficients d, will be given here. 

Let x = difi(y) + dofe(y) + --- + d,f,(y). We will choose the 
p coefficients d; given by the row vector d’ = (d, , d., --- , d,) to maxi- 
mize a certain ratio of sums of squares of the z’s. Thus in a simple 
two-way classification Tukey considers maximizing 


row sum of squares of the z’s + column sum of squares of the 2’s. 
residual sum of squares of the 2’s 


The method can be used to maximize any such ratio; and, provided 


we have a within-subclass sum of squares available, a general criterion 
would be to maximize 


within-subclass sum of squares of the 2’s 


all interaction sums of squares of the 2’s , 


since this would minimize any interaction variance component. 

Let si(fif;) and s2(f;f;) be the numerator and denominator sum of 
squares respectively of the transformed data f;(y) in the ratio it is 
desired to maximize. Thus if we use the general criterion suggested 
above, s,(f;f;) is the within subclass sum of squares computed from the 
transformed data f;(y), and s.(f;f;) comprises all interaction sums of 
squares as computed after using the same transformation. Let s,(fjf;) 
and s,(f,f;) be respectively the corresponding numerator and denomi- 
nator “sum of cross-products” of f;(y) and f;(y). For example, if 
8, (f:f:) were a row sum of squares, s,(f;f;) would be obtained as the 
sum of cross-products of row sums, divided by the usual divisor and 
less a corresponding correction term for the mean. If s,(f;f,) is the 
within subclass sum of squares, then s,(f,f;) is obtained exactly analo- 


i 


218 BIOMETRICS, JUNE 1961 


gously, except that f;(y) and f;(y) are used to obtain cross-products 
instead of just f;(y) to obtain squares. 

Let S, and S, be p X p matrices whose elements in the i-th row 
and j-th column are s,(f,;f;) and s2(f;f;) respectively. 
Then 


8 (rz) = dis,(f.f,) + 2 d; = d, 
t=1 
where s,(x2) is the numerator sum of squares of the x’s and d is a column 
vector, the transpose of d’. Similarly 
s.(rz) = d’S, d. 


We thus wish to maximize d’S,d/d’S.d. Differentiating this with 
respect to d and equating to zero we obtain p equations that we may 
write in vector notation: 


Sid, _ 
24s, d 2 d's, d)? S.d = 0, 
where 0 is a column vector of p zeros; i.e. 
where 
_@S.d 


Thus the largest value of \ is the value of the largest characteristic 
root of (S,S;*), and using this value of \ we choose d to satisfy (16). 
The individual d; are not uniquely determined by (16), but all ratios 
d,/d; are. If we denote the element in the i-th row and j-th column of 
(S: — AS.) by s;; , we can easily find, for example when p = 2: 


d,/dz = —82/8\, ; 

and when p = 3: 
= (813822 — — $12813), 
d,/ds = (82833 — 813823)/(811823 — 812813). 


If we can find a d which makes all interaction sums of squares of 
the z’s non-significant, we might assume the E(x) are additive and so 
estimate our class effects on this scale. Unfortunately, however, it is 
not clear what hypotheses can be tested: any F-statistics we may 
obtain are influenced by our choice of d. This procedure is therefore 
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best restricted to the case where two independent sets of similar data 
are available; d can be estimated from one set of data, and using this 
d the other set of data can be transformed and analyzed. Then, if we 
assume normality of the transformed data, tests of significance will be 
valid; though only one set of the data should be used in making them. 

The computational procedure in the case of unequal subclass num- 
bers will not be discussed in any detail here. However it should be 
noted that a general solution has already been given, in another context, 
by Roy [1957]. If we equate Roy’s x’ to the vector of transformed 
variables associated with the r-th observation y, , i.e. to [fi(y,), 
fe(y-), «°° » fo(y-)], then S, and S, in this paper can be equated to 
Roy’s S and S* respectively. 
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A NOTE ON. SOME GROWTH PATTERNS IN A 
SIMPLE THEORETICAL ORGANISM 


J. A. NELDER 
National Vegetable Research Station, Wellesbourne, Warwick, England 


INTRODUCTION 


Hinshelwood and his co-workers [1946, 1955] have considered simple 
enzyme systems whose behaviour might mimic the growth of bacterial 
cultures under certain conditions. It is well known that the bacterial 
growth cycle of cell number on a given volume of medium divides 
itself into three main phases (Figure I). The first phase (or lag phase) 
represents a ‘settling-in period’ when growth may be slight or irregular; 
in the second phase, growth is logarithmic (that is log number is linearly 
related to time); finally in the third phase the relative growth rate 
falls from its constant value in the second phase to zero, often very 
rapidly, and the number in the colony becomes more or less steady. 
The lag time on transfer to a new culture may be generally defined by 
extending the linear portion of the logarithmic phase to the time axis 
(OT in Figure I). Considerable interest attaches to the form of the 
lag phase following (a) the transfer of cells from an ageing culture 
(ie., one in the third phase) to a new medium and (b) the addition 
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of a drug to the new medium. Hinshelwood has considered [1946, 
chap. IV et seq.] forms of lag produced in a very simple theoretical 
organism consisting of two linked enzymes, I and II, both of which 
are autocatalytic; thus enzyme I uses substrate outside the organism 
to produce more of itself and also an intermediate C, while II uses C to 
produce more of itself. Cell division is assumed to be geared to the 
amount of II. One of his equations of growth, however, appears to 
need amendment, and it is fortunate that with this amendment the 
equations have an explicit solution so that it becomes possible to re- 
place his approximate treatment of the lag phase by an exact one in a 
number of different situations. 


THE EQUATIONS OF GROWTH 


We write X, and X, for the total amount of enzymes I and II in 
the system at any time, n for the total number of cells, Y for the total 
amount of intermediate, and y = Y/n for the concentration of inter- 
mediate on a per cell basis. The equations for the growth of the enzymes 
are then given by 


‘¢ 
(1) 
dx, 
(2) 
while the growth of the intermediate is given by 
= AX, CY, (3) 


where AX, is the rate of production by enzyme I, —BX,.y the rate of 
consumption by enzyme II, and CY the loss by diffusion and irrelevant 
chemical processes, which must be proportional to the concentration 
and the number of cells n. (The notation is the same as that in Dean 
and Hinshelwood [1955] except that we have used y for c and have 
introduced Y = nc in their notation). [Equation (3) differs essentially 
from the corresponding one given by Dean and Hinshelwood in having 
dY/dt = d(nc)/dt instead of n dc/dt. The difference arises because 
their equation does not take into account the fall in concentration 
of the intermediate due to the expansion of the system. This fall will 
be given by —(y/n)(dn/dt) in our notation, so that in terms of con- 
centration the equation for y is given by 


= 
dy _ A X, B y dn 
l n n n dt a 
; 
j 
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whence 
dy dn _ 7 


thus reducing to (3), as it must. 

Hinshelwood postulates that the amount of enzyme II controls cell 
division which thus acts so as to keep X./n, the concentration of II, 
roughly constant. In what follows, we follow him in ignoring the 
changes in X,/n and the diffusion coefficient C due to the discontinuous 
nature of the division process, and assume that the system can be 
taken as expanding continuously in such a way that X,/n is constant, 
also that the area/volume ratio is constant so that C is unrelated to n. 
We therefore put X. = n6 where @ is a constant (and equal to 67° in 
Dean and Hinshelwood’s notation), whereupon equations (1), (2) and 
(3) become the linear set 
= = AX,— Y(Be+C). (4) 

The general solution of (4) may be found by the usual methods 
and gives 


= 


X, = + ke’, 
X, = Ae + Q2 — Qsk20e (5) 
== Q,k, Ac" 


where Q, , Q2 , and Q; are arbitrary constants and a = B6+C. Ast 
becomes large the organism tends to a steady state where X, , X. , and 
Y are all growing logarithmically in a constant ratio given by 


:k.0A:k,A (6) 


When the organism is set going from a state different from the steady 
state given by (6), a lag phase will appear before the organism settles 
down into the logarithmic growth pattern. Two types of lag will be 
considered: (a) those produced by a decay in X, or Y (these possibili- 
ties are envisaged by Hinshelwood as being consequences of ageing 
in a culture) and (b) those produced by a drug which changes the value 
of one of the parameters in (4). 


GROWTH FOLLOWING THE DECAY OF ENZYME AND INTERMEDIATE 
(i) The decay of X, 


Suppose that at? = 0, X,:X.:Y = pki(a + k,) : : kA, ice. 
that relative to X, and Y, X, has declined to a fraction p of the steady 
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state ratio given by (6). Solving for Q, , Q. and Q; in (5) we find 


n = X./6 = constant 


x {(o/te) +0 +3) 


Qa 


Without loss of generality we may define the unit of so that 
n = 1 at ¢ = O and the unit of t so that k, = 1. Then (7) becomes 


n= pel + (1—p) (8) 


As t becomes large 
n~ pe’, Inn~Inp+t. 


Hence the lag time 7 as defined above is obtained by putting 
In n = 0, whence 7 = —In p. Now a is a positive quantity in (8) 
and (1 — e “‘)/a@ is a non-increasing function of a for any positive t; 
asa — 0, (1 — e *')/a t while as a > &, (1 — e*')/a > 080 that 
extreme curves of the family (8) for fixed p are given by 


n= pe’ + (1 — p)(1 + 2), 
pe’ + (1 — p). 


and 


(10) 


(ii) The decay of Y 


If the amount of intermediate Y decays to a fraction p in the steady- 
state ratio (6) while the enzyme amounts remain fixed, then we obtain, 
corresponding to (8), the equation 


n=e' — — — e/a]. 
The lag time is thus zero and the curves lie between 


n=e' — (1 — @@=0), and n=e', (= 


GROWTH FOLLOWING CHANGES IN PARAMETER VALUES 


One possible explanation of drug action is that it changes values 
of the parameters in the growth equations; thus an intermediate may 
be inactivated by the drug and be rendered more or less unavailable to 
the next enzyme in the chain, or active sites on an enzyme may be 
blocked, and so on. In the simple organism considered here growth 
depends on 5 parameters, k, , k. , 6, A, anda = B@+C. We shall 
not consider variations in @ or k, ; if @ varied, then the drug would 
change the mean cell size and so alter C as well, while if k, is permanently 
changed, the final steady-state growth rate will be changed. We thus 
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consider effects on k, , A, and a which do not change the mean cell 
size or affect the steady-state growth rate after adaptation. In addition 
the drug will be assumed to be present in excess so that the effect on 
the parameters can be taken as fixed and independent of time. The 
results are summarised below: 


(iii) Fallin A 
The drug affects the production of intermediate by enzyme I. If 
A is reduced to a fraction p of its former value and cells are in their 


logarithmic phase before treatment then, following the same conven- 
tions as before 


n = pe’ + (1 — p) + [((1 — — &*')/e] 
so that the effect is identical to that of a corresponding fall in the 
amount of X, (equation 8). 
(iv) Fall in k, 
Here the drug affects the autocatalysis of enzyme II, and 
n=p'+(l — p), 
which is an extreme case, as a > ©, of equation (8). The lag in both 
these cases is given by T = —In p. 
(v) Rise in a 


In this case the drug is assumed to mop up the intermediate as it 
is produced, thus increasing C and hence a. The quantity a can also 
be increased by increasing B, the rate of use of the intermediate by 
enzyme II, but this seems a less likely effect of drug action. The cell 
number is given by 


* [a + aje a(l — p) (l-—e”*’) (11) 


where p > 1, since a is assumed to have increased. ‘The lag is given 
by 7’ = In[(1 + pa)/(1 + @)]. The extreme members of (11) are given 


n=e for a=0, (12) 
and 
n=ne'+(1—7) fr a=o, «r=I1/p. (13) 


Equation (12) of course gives logarithmic growth with no lag, while 
(13) has been met previously as one of equations (10). 
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GROWTH FOLLOWING DISTURBANCE OF TWO QUANTITIES 
OR PARAMETERS 


In this section we consider only the growth following the disap- 
pearance of intermediate accompanied by changes in X, or one of the 
parameters A, k, , or a. Three of these cases produce the same equa- 
tion for n, namely those having a fall in XY, , A, or ky toa fraction p of 
their steady state value. All these give 


n= pe + (1 — p) — [pl — 


with lag T = —In p, and extreme curves 
n=pe'+(1—p)—pt for a=0, 
n = pe’ + (1 — p) for a= o. 


The effect of a is not large here; the curves having a = 0 have a 
slightly more sudden rise to the logarithmic asymptote. 

For a rise in a to pa accompanied by an initial value of Y = 0 
we get 


The lag is T = In [(1 + pa)/(1 + a@)] and the extreme curves are 
given by 
n=e'—t for a=0, 


+(l1—7, «r=1/p for a=, 


3 
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EXAMPLES OF GROWTH CURVES 


Cases (i) and (iii) give the same family of curves. Examples of 
these are shown in Figure II (a), (b), and (c) for the extreme values 
of a (0 and &), and for a = 1, the curves being given for lags equal 
to 2, 4, 8, and 16 generation times. (On our standard scale with k, = 1, 
the generation time is In 2 = 0.693 units.) Case (iv) is covered by 
Figure II(b), while case (v) has as extremes the simple zero-lag line 
Inn = t for a = O and the curves of Figure II(b) fora = ©. For 
a = 1, curves very similar to those of Figure II(b) are obtained. In 
Figure II1(d) an example is given for case (ii) with the extreme values 
a = 0, p = 0; for p < 1, these curves are sigmoid and asymptotic to 
the no-lag line In n = ¢ from below, the slope at the origin being p for 
all finite a. 

For growth following complete loss of Y accompanied by a change 
in X, , A, kz or a, the curves are similar to those of Figure II(b) for 
all positive a, and examples are not given. 
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FIGURE II 


EXAMPLEs oF GrowTH CuRVES AFTER DISTURBANCE FROM THE STEADY STATE 


(a) Curves of the family n = net + (1 — p)(1 +2) 
(b) Curves of the family n = pe? + (1 — pd) 
(c) Curves of the family » = ve* — (1 — p)(2 — e7*) 


(d) The curve n = e+ —¢ 
Notes: the ordinate is In n througnout. in (a), (b), and (c) p takes tne vaiues 2~*, 2-4, 2-3, and 2-18, 
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DISCUSSION 


Though the “organism” discussed in this note is a very simple one, 
the curves show that it is capable of a variety of different growth 
patterns after disturbance from the steady state. The curves exempli- 
fied in Figure II(c) are somewhat similar to one of those shown in Figure 
10 of Hinshelwood’s book (Hinshelwood [1946]), and described by him 
as an “irregular growth curve”. However we have not succeeded in 
producing a curve such as that shown in Figure 11 of the same work 
where growth is very slight for about 4 generation times and the loga- 
rithmic phase is then entered very rapidly indeed. When the lag is 
as short as 4 generation times, none of the curves produced by the 
model has a near-horizontal early part. It is only when the lag reaches 
about 10 generation times that we find in some cases a substantial 
period at the beginning when growth is very slight. 

One way of producing a curve of the type of Hinshelwood’s Figure 11 
might be to postulate a drug which combined with the intermediate 
and prevented its use by enzyme II, the drug itself becoming inacti- 
vated by the combination. In this situation the amount of intermediate 
available to enzyme II would be kept very low until all the drug had 
been immobilized after which it would rise io the stable state level. 
The general question of the behaviour of the organism ‘growing away’ 
from a drug after immobilizing it is complex and does not seem amenable 
to exact solution. Similarly the growth equations for Hinshelwood’s 
other theoretical organisms, such as the one having two cyclically 
linked enzymes (Hinshelwood [1946], p. 81 et seg.), or alternative path- 
ways (ibid. p. 150 et seq.) appear to have no explicit general solution, 
though of course numerical solutions for given values of the constants 
could easily be obtained. 

A striking feature of the model is the occurrence of similar or identi- 
cal growth equations of n following different changes of the steady 
state. Since these changes have quite distinct biological interpreta- 
tions, it is clear that it will rarely be possible to deduce from the shape 
of a growth curve the sort of mechanism likely to have produced it. 


SUMMARY 


The growth equations for a simple organism proposed by Hinshel- 
wood, and consisting of two linked autocatalytic enzymes, are shown 
to produce a linear system under certain conditions. 

Solution of these equations gives the form of the lag in growth 
following (i) decay of one enzyme and/or the intermediate and (ii) 
changes in the values of the parameters such as might be brought 
about by drug action. 


2 


228 BIOMETRICS, JUNE 1961 


Examples of the types of curves produced are given, and their 
resemblance to actual bacterial growth curves discussed. The produc- 
tion of identical curves by several distinct mechanisms in the model 
is pointed out. 
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1. Introduction 


The diallel cross, which is composed of all possible single crosses 
among a group of inbred lines, is now a common plan of investigation 
in both plant and animal breeding. Its modern use starts apparently 
with the development of the concepts of general and specific combining 
ability by Sprague and Tatum [1942]. The diallel cross is used to 
estimate the genetic components of the variation among the yields of 
the crosses (see, for instance, Hayman [1954a, b]; Jinks and Hayman 
[1953]; Griffing [1956a, b] and Kempthorne [1956, 1957]). It is also 
used to estimate the actual yielding capacities of the crosses. This 
information may be employed, for example, to select the best four 
inbred lines from which to develop a four-way cross. We-shall discuss 
only the relatively simple situation in which there are no maternal 
effects, i.e. reciprocal crosses are identical and so need not be made, 
and in which there is no interest in the performance of the inbred lines 
themselves. The important questions concerned with replication over 
years and locations will not be considered. The methods used and 
conclusions reached in this paper may be capable of extension to more 
complicated situations. 

With no reciprocal crosses or crosses resulting from selfing or crossing 
within the same inbred line, there are "C, = n(n — 1)/2 possible single 
crosses among n inbred lines. This number of possible crosses in- 
creases rapidly with n. When n = 6 it is only 15, when n = 20 it is 
190, and when n = 50 it is 1,225. With facilities available for testing 
only a limited number of crosses, a diallel cross may only be possible 
between a relatively small number of inbred lines. If only a small 
number of inbred lines are tested, the estimate of the variance of the 


Journal Paper No. J-3909 of the Iowa Agricultural and Home Economics Experiment Station, 
Ames, Iowa. Project 890. 

2The work on this paper was completed while the latter author was visiting Iowa State University 
on a Harkness Fellowship of the Commonwealth Fund. 
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general combining abilities among the whole population of potentially 
available inbred lines will be subject to a large sampling error and 
many potentially high yielding inbred lines left completely untested. 
The question arises, therefore, of whether a design involving more 
inbred lines but only a sample of all possible crosses between them 
may not be preferable. A particular method of sampling the diallel 
cross will be considered and its efficiency in estimating the genetic 
variance components, the differences between the yic'ds of the various 
crosses and the general combining abilities of the lines discussed. 


2. The Partial Diallel Cross 


The best method to be used in deciding how to sample the diallel 
cross would be to specify, in general terms, the probabilities of sampling 
each particular cross and each particular pair of crosses and then choose 
these probabilities so as best to satisfy the aims of the experiment. 
We have not been able to do this. We shall consider only the particular 
method of sampling the crosses suggested by G. W. Brown in about 
1948. The method certainly achieves some balance and whether a 
much better one exists is rather doubtful. It has already been used 
twice at Iowa State University (Jensen, [1959]; Sprague, unpublished.). 

Assume that the breeder can handle a total of ns/2 crosses where 
n is the number of inbred lines and s is a whole number greater than or 
equal to 2. Clearly, n and s cannot both be odd. The n inbred lines 
are numbered at random from 1 to n and the following crosses sampled :— 


line 1 X linesk +1,k +2,--- ,k +8 
line 2 X linesk + 2,k 4+ 3,--- 


linet X linesk +i,k +724 1,--- 


linen X linesk +n4+ 1,--- ,kK+n—1+458, 


where k = (mn + 1 — s)/2, and is a whole number, and all the numbers 
above n are to be reduced by multiples of n so as to be between 1 and n. 
For k to be a whole number, either n is odd and s even or n is even 
and s odd. Each line occurs in s crosses and the total number of crosses 
sampled is ns/2. s = n — 1 corresponds to the complete diallel cross. 
The reader may have noticed the analogy between this method of 
sampling the diallel cross and the experimental design for blocks of 
two plots in which the s blocks containing treatment number 7 also 
contain treatments numbered k 4-7,k +744 
These circulant designs are discussed by Kempthorne [1953]. ‘To 
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every design for blocks of two plots in which each treatment occurs 
the same number of times, there corresponds a method of sampling 
the diallel cross in which each line is involved in the same number of 
crosses, and conversely. Treatments 7 and j occurring in the same 
block corresponds to sampling the cross i X j. Any balanced in- 
complete block design corresponds to the complete diallel cross. Partial 
diallel crosses corresponding to other two plot per block designs have 
not been considered. Partial diallel crosses corresponding to other 
circulant designs, including some with n and s both even, (Zoellner 
and Kempthorne, [1954]), could be studied by methods very similar 
to those of this paper. 

We shall assume that the yield from the cross 7 X j in replicate | 
can be written 


ten, 


where u is a general effect, r; a replicate effect, g; and g; are the parental 
effects (sometimes called general combining abilities), s;; is the effect 
of the non-additivity of the parental effects (sometimes called specific 
combining ability) and e,;;; is the plot error. We shall further assume 
that g; , s;; and e,;;, are independently normally distributed with zero 
means and variances o; , o, and o, . The motivation for this model 
is as follows. The yield of cross 2j in replicate / is assumed to consist 
of three parts combining additively: an effect of the cross, a replicate 
effect and an error due to plot deviation and also to segregation within 
the cross, if there is any. As regards the cross effect, different progeny 
of the same cross are full sibs, and progeny of two different crosses 
involving a common line are half sibs, and this is the only genetical 
structure. If the lines are a random sample from a large population, 
the cross effect can be represented by 


gi + gi + 
in which g; , g; and s,; are assumed to be independent random vari- 
ables with variances , and o% respectively, where 
o, = Cov (HS.) 
and 


= Cov (FS.) — 2 Cov (HS), 


H1.S. denoting half-sibs and F.S. denoting full-sibs. 

The diallel cross can be used with multi-flowered plants and, if the 
plants used are a random sample of the population of plants, the above 
covariances are covariances of relatives in that population. If further- 
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more that population has random mating structure, is not inbred and 
there is no linkage, 


Cov (H.S.) = 16, + + 
and 
Cov (F.S.) = 404 + 


If the parents are individuals arising by inbreeding to degree F in 
such a population, then (Cockerham [1954], Kempthorne [1957] 


2 
Cov (HS.) = (1+ re + 
and 
2 2 
covers) = + + 


If F equals unity, i.e. the parents are completely inbred, Cov (H.S.) is 
equal to the covariance of parent and offspring in the original random 
mating population and Cov (F.S.) is the genotypic variance in the 
original population. If the lines are only partially inbred, genetic 
interpretation is possible only if the degree of inbreeding is constant 
over the lines and is known. 

For a general value of F, all we know about o% and o% is that the 
former, ¢; = Cov (H.8.), involves only the variances due to additive 
effects and interactions of additive effects and that the latter, o2 = 
Cov (I°.8.) — 2 Cov (H.8.), does not involve the variance due to additive 
effects, ¢; . If the lines are completely inbred, 


2 2 2 

and 

2 2 2 

o, = op + 3044 + 


The total genotypic variance is 2c? + o? and, if epistacy can be ignored, 
the additive variance is 267 . The ratio of additive to total genotypic 
variance would then be 


20;/(20; + 


and the square root of twice the ratio of dominance to additive variance, 
which, if gene frequencies are equal to 3, is interpretable as the average 
degree of dominance, is 


« 
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If the lines are not inbred at all, i.c. F = 0, 


2 2 2 
417A + T6TAA + 


and 
2 2 2 


If epistacy can be ignored, the ratio of additive to total genotypic 
variance is 


+ 
and the average degree of dominance, (see above) 
V . 


The plot error variance o? will contain a component due to genetic 
variability within crosses. In fact it will contain the total genotypic 
variance less the covariance of full-sibs and this is zero only if F equals 
unity. The environmental variability in the plot error e;;; consists 
of plot to plot variability plus environmental variability particular to 
each individual and, if there were competition, would also contain a 
component from this force. 

The above model seems entirely appropriate for the consideration of 
the estimation of of and o? , which are known as half the variance of 
general combining ability and the variance of specific combining ability 
respectively. Likewise it seems entirely appropriate for the estimation 
of the covariances of half-sibs and full-sibs, or estimation of related 
quantities like the average degree of dominance. 

It is less appropriate for the consideration of the yields of possible 
multi-way crosses, such as two-way or four-way crosses, because the 
plant breeder will be in the position of having a specified set of lines 
and is interested in the potentialities within that set of lines rather 
than within a random set of lines that he might have obtained. But 
it appears to us that even in this case the plant breeder has no alter- 
native to assuming an additive model in which the yield of cross 7 X j 
is made up of an effect due to line 7, an effect due to line j, and an effect 
due to the non-additivity of the effects of lines 7 and j. Earlier an 
attempt was made to consider the situation in the framework that 
there was a finite population of N lines from which n were drawn at 
random and the partial diallel cross made among these n lines. Un- 
fortunately, considerable mathematical difficulties were encountered 
and no neat result obtained. We shall therefore look at the problem 
of estimating all possible single crosses by the use of the simple additive 
model described above. 
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3. Estimation of the Variance Components 


We shall estimate the general combining abilities g, , --- , g, by 
least squares, i.e. by choosing , , to minimize 


where >>, denotes summation over the sampled crosses and y;; the 
mean yield of cross i X j. With the imposed constraint 


4. =0, 


this leads to the equation @ = 7, the average of the y,,’s, and to the 


following equations for , , 

207 

7=1 r=0 ns 


where G is the grand total of cross averages and a,;; = s, all 7, and 
a;; = a;; = 1 if crossi X j is sampled and a;; = a;; = 0 otherwise. 
The n X n matrix A = [a,,;] is a symmetric circulant matrix and there- 
fore so is its inverse, AT = [a‘’]. (The general form of a circulant 
matrix is given in the appendix at the end of this paper. A symmetric 
circulant matrix has the additional property that the element in the 
ith row and jth column is the same as the element in the jth row and 
ith column for all i and 7.) Being a symmetric circulant, the elements 
a‘’ of the matrix A™* are functions only of | 7 — j |, the positive value 
of (¢ — j). We shall therefore write a‘) = a'‘"'. By multiplying 
together rows of A with columns of A™‘, 


a sa" (3.2) 
r=k 
and 
> a’ = I. (3.3) 
r=k 


In (3.3), the ¢ + r index in the summation is to be reduced by multiples 
of n so as always to be between 0 and n — 1. By summing (3.3) from 
t= 1tot = n — 1, and using (3.2), the sum of any row of A“ is 


n-1 
> a’ = 1/2s. (3.4) 
r=0 

The total sum of squares of cross averages in the analysis of variance 


of the partial diallel cross can be decomposed as follows: 
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(yi; = > + (Wii 9 9)”, 


where 7 is the mean of the cross averages. 
Now from (3.1), and (3.4) 


4.0. = a"'Q.Q, 


n e-1 


7,7=1 l,m=0 


lixing a particular sampled cross, i X (¢ + k + I), and considering all 
sampled crosses, 7 X (j + k + m), related to it, either as full or half 
sibs, and using (3.2), (3.3) and (3.4), 


n s-l 2 


+ Cov (F.S.) — 2 Cov ats)} + Cov(HS.). (3.6) 


Summing (3.6) over i and 1, again using (3.2), (3.3) and (3.4), and 
substituting an expression for E(G’), (3.5) gives 


4.0.) = (n - + Cov (F.S.) — 2 Cov 


+ s(n — 2) Cov (HS,) 


Table 1 shows the analysis of variance of the partial diallel cross, with 
the expected values of the mean squares written in terms of of and a; 
instead of in terms of Cov (I'.S.) and Cov (H.8.). 


TABLE 1 
ANALYSIS OF VARIANCE OF PARTIAL DIALLEL Cross 
Source d.f. Expected values of mean squares 

Replicates 
General Combining 

Ability n—1 + roe + {rs(n — 2)/(n — 1)} 03 
Specific Combining 

Ability n(s/2 — 1) + 
Replicates X Crosse. | (r — 1)(ns/2 —1) | o3 

Total rns/2 — 1 
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With a complete diallel cross there are always many more degrees of 
freedom for the s.c.a. (specific combining ability) mean square than for 
the g.c.a. (general combining ability) mean square. Unless o? is small 
compared to ¢: + ro. , this may be a serious disadvantage in the esti- 
mation of 3 . The partial diallel cross does allow the (ns/2 — 1) 
degrees of freedom for crosses to be split more evenly between the two 
mean squares. Clearly, for a? to be estimable, s has to be greater than 2. 
With s = 3, there will be nearly twice as many degrees of freedom for 
the g.c.a. mean square as for the s.c.a. mean square. With s = 4, the 
degrees of freedom will be approximately equal. Table 2 shows the 
breakdown of the degrees of freedom for an experiment involving 2 
replicates of 120 plots each when the crosses are (i) a complete diallel 
cross (s = n — 1 = 15), (ii) a partial diallel cross with s = 3(n = 80) 
and (iii) a partial diallel cross with s = 4(n = 60). The determination 
of the optimal numbers of replicates r, inbred lines n, and crosses per 
inbred line s/2 will involve the unknown values of of/o2 and 07/0? as 
well as the cost function of the experiment. Another difficulty in 
deciding on a value for s is that an exact specification of the aims of the 
experiment is necessary. One possible aim of the experiment is to 
estimate components of genetic variance such as the additive and 
dominance portions and the goodness of the design will depend on 
these and on the inbreeding coefficient of the lines. A compromise may 
have to be made between various aims. The proportion of the genetic 
variance that is additive (I*isher, [1918]) and the average degree of 
dominance (Comstock and Robinson, [1948, 1952]) are both, under 
severe assumptions (see Section 2), functions of o7/o? . Again, measures 


TABLE 2 


DEGREES OF FREEDOM FOR COMPLETE AND For PARTIAL DIALLEL 
Cross Usine 2 Repiicates or 120 PLots 


Source Degrees of freedom 
Complete diallel cross Partial diallel cross 


Replicates 1 1 1 


G. c. a. 15 79 59 
S. c. a. 104 40 60 
Replicates X Crosses 119 119 119 


Total 239 239 239 


3 


| 
| | s=3 s=4 | 
| 
| | | 
‘ 


THE PARTIAL DIALLEL CROSS 237 


of heritability will be functions of o? , o? , and o?. A design that mini- 
mizes the variance of the estimates of o7 and o% does not necessarily 
minimize the variance of the estimates of these functions. For example, 
by increasing the degrees of freedom for the g.c.a. mean square at the 
expense of the degrees of freedom for the s.c.a. mean square, the variance 
of the estimate of o? is increased and the covariance between the esti- 
mates of of and of made more negative. This may result in an increase 
in the variance of the estimate of 7/07 , despite the decreases in the 
variance of the estimate of 0% . 


4. Comparison of Partial Diallel Cross with Other Designs for Estimating 
the Variance Components 


A comparison of the partial or complete diallel cross with other 
designs for estimating the variance components is complicated by all 
the factors mentioned at the end of the last section. The experiment 
analogous to what Comstock and Robinson [1952] called Experiment I 
would be to cross each of m randomly chosen inbred lines used as 
“sires”? with m different sets of f randomly chosen inbred lines used as 
“dams”. This type of experiment has been widely used in poultry 
to estimate covariance of full-sibs and half-sibs. No inbred line would © 
be used both as a “‘sire’” and a “‘dam’’. The analogy is not complete 
since the experimental material considered by Comstock and Robinson 
was produced from random matings among plants of the 7, generation 
of a cross of two inbred lines, whereas we are considering the progeny 
resulting directly from crosses among a set of inbred lines. The analy- 
sis of variance of Experiment I is shown in Table 3. The variance of 
the estimates of both o? and o; with this design can be shown to be 
greater than the corresponding variances for the partial diallel cross 
with n = mands = 2f. The two designs involve the same number of 


TABLE 3 


ANALYSIS OF VARIANCE OF AN EXPERIMENT IN WHICH m INBRED 
LINES ARE Eacu CrossEpD TO A DIFFERENT SET OF f INBRED LINES 


Source df. Expected values of mean squares 
Replicates r—1 
“Sires” m—1 otro trft1)o; 
‘Dams in Sires’’ mf — 1) oe tro, 
Replicates X Crosses (r — 1)(mf — 1) a. 


Total rmf —1 
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crosses but the partial diallel cross uses f fewer inbred lines. The 
covariance between the estimates of o? and o? is less negative with 
the diallel cross than with Experiment I. The experiment analogous 
to Experiment II of Comstock and Robinson [1952] would be to make 
all the crosses between m randomly chosen inbred lines used as “‘sires’’ 
and f randomly chosen inbred lines used as ‘‘dams’’. No inbred line 
would be used both as a “‘sire” and a “dam”. The analysis of variance 
of this design is shown in Table 4. An estimation procedure that does 
not use both the sire and dam mean squares to estimate of can be 
shown to be inferior to the estimation procedure possible with a partial 
diallel cross with n = mand s = 2f, i.e. a partial diallel cross involving 
the same number of crosses but f fewer inbred lines. Comstock and 
Robinson [1952] have suggested that, when possible, Experiment II 
should be designed with m = f. This is not necessarily optimal, but it 
does permit a simple pooling of the dam and sire mean squares. Un- 
fortunately, it also results in many more degrees of freedom for the 
s.c.a. mean square than for the g.c.a. mean square. There will be 
(m — 1)/2 times as many degrees of freedom for the s.c.a. mean square 
as for the g.c.a. mean square. Unless? is small compared with o? + ro% , 
this may be a serious disadvantage in the estimation of o{ . Indeed 
one of the main general reasons for using the partial diallel cross is that 
it gives a reasonable number of degrees of freedom for the g.c.a. mean 
square. 

A comparison of the partial diallel cross with Experiment III of 
Comstock and Robinson [1952] and other more complicated designs 
will not be attempted. Experiment III may be superior to the partial 
diallel cross. A complete comparison of the two designs would again 
involve the values of unknown parameters and would also raise questions 


TABLE 4 


ANALYSIS OF VARIANCE OF ALL Crosses BETWEEN 


Source ad. Expected values of mean squares 
Replicates r—1 
“Sires” m—1 + ro, + rfo; 
“Dams” f-1 + ro, + rmo; 
“Sires X Dams’’ (m — 1)(f 1) +10 
Replicates X Crosses | (r — 1)(mf — 1) e, 
Total rmf — 1 
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regarding the sensitivity of the estimation procedures to departures 
from some of the genetic assumptions. 

All the designs discussed so far have involved crosses between lines 
both of which were drawn at random from the population of inbred 
lines. One result of this is that all of the variation between crosses 
can be used to estimate either of or of . There are two serious dis- 
advantages involved in the use of common testers that are not a random 
sample from the same population as the inbred lines. Firstly, the 
general combining ability of a line has to be defined as the average 
performance of that line when crossed to all members of a certain 
population. The average performance of an inbred line when crossed 
to a set of common testers will almost certainly not be the same as its 
average performance when crossed to all other members of the popula- 
tion of inbred lines. This could seriously invalidate the estimate of o; . 
Secondly, there would seem to be little or no reason to assume that the 
variance of the specific combining abilities among crosses between 
inbred lines and common testers is equal to the variance of the specific 
combining abilities among crosses between the inbred lines themselves. 
These considerations strongly suggest that common testers should not 
be used to estimate the values of o7 and o; for the population of inbred 
lines, unless the common testers are themselves a random sample from 
that same population. 


5. Comparing the Yielding Capacities of the Crosses 


We shall make the same assumptions and use the same notation as 
in the previous sections of this paper. We shall consider the partial 
diallel cross as a method of estimating the yielding capacities of all 
the possible single crosses among n inbred lines. Inbred lines are 
often developed and then crossed in an attempt to produce crosses 
with a high yielding capacity. The yielding capacity of all crosses in 
the diallel cross and all sampled crosses in the partial diallel cross can 
be estimated in each of two ways. Firstly, they can be estimated by 
their mean yields in the experiment. Secondly, specific combining 
ability can be ignored and the yielding capacity of the cross 7 X j 
estimated by @ + g; + g; .° Clearly, the latter method has to be used 
to estimate the yielding capacity of all the unsampled crosses in the 
partial diallel cross. 

We shall designate the methods of estimation A and B, where A 
and B are defined as follows: 


3The two estimates could possibly be given appropriate weights and combined into a single esti- 
mate. For the partial diallel cross these weights are rather involved and vary from cross to cross. In 
this paper, the two methods of estimation will be considered separately and then compared. 
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A. Unsampled crosses estimated by @ + g; + g; but sampled crosses 
estimated by cross means 7;; . 
B. Both unsampled and sampled crosses estimated by @ + §; + @; . 


A more precise statement will be made later, but one may summarize 
briefly that B will be preferable to A only if ro?/o? is small. 

A third method C of estimating the yielding capacities of the crosses 
is to cross all n inbred lines with each of t common testers. As mentioned 
previously, general combining ability is not a property of the line alone 
but a property of the line relative to the population of lines to which 
it has been crossed. To speak of the general combining ability of a 
line without reference to that population is vague if not meaningless. 
If common testers are to be used to estimate the yielding capacities of 
crosses between the inbred lines then we have to make the assumption, 
and it is a big assumption, that the general combining ability of each 
inbred line relative to the common testors is the same as its general com- 
bining ability relative to all the other inbred lines. We hope that the 
importance of this assumption will not be lost in the discussion that 
follows. Without it there is no basis for comparing the diallel cross 
with common testers. In method C, we shall estimate the yielding 
capacity of crossi X j by & + g; + g; where g; and @; are the estimates 
of the general combining abilities of lines 7 and j with the common 
testers. Like B, C will be preferable to A only if ro?/o? is small. Neither 
of the two designs alternative to the diallel cross considered in Section 4 
can be used to estimate the differences between crosses without con- 
founding some of these differences with other contrasts between the 
general combining abilities. They will therefore not be considered 
further. 

In all three methods, A, B and C, the errors involved in comparing 
any two crosses will be composed of two parts. There will be errors 
arising from an inadequate estimation of specific combining abilities 
and from the specific combining abilities that enter into the estimates 
g; . There will also be errors arising from the plot effects. To measure 
the error in comparing any two crosses, we shall calculate the expected 
value of the square of this error. Tt will be composed of two parts, 
one involving o% and the other o? . The criterion Q, used to measure 
the efficiency of the various methods, will be the average, over all 
"@-D)C possible comparisons among the n(n — 1)/2 crosses, of this 
expected square error. The values of Q for methods A, B and C will 
be written Q, , Qz and Q- respectively. 

With all three methods of estimation, comparisons can only be 
made between crosses invoiving the inbred lines actually tested. This 
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is an obvious statement, but that any design not involving each inbred 
line at least once has Q = @ should be realized. As a result, the cri- 
terion Q cannot be used to decide on the optimal division of resources 
between the number of inbred lines on the one hand and the number of 
replicates and crosses per inbred line on the other. The number of 
inbred lines tested n is fixed and we need to estimate the yielding 
capacities of all crosses among them. A decision on the value of n 
would presumably involve a compromise between the accurate assess- 
ment of a relatively small number of crosses and the relatively inaccu- 
rate assessment of a large number of crosses. The more crosses tested 
the more intense can be the selection applied to them but the larger 
will be the errors involved in that selection. Problems of this kind are 
discussed in a series of papers by Finney [1958 a, b; 1960]. The methods 
he used to study mass selection in plant breeding cannot be applied 
directly to the present problem because of the unequal accuracies and 
the correlations involved in the estimation of the different crosses and 
because of the genetic covariance o; between crosses involving a common 
line. Also, the aim may not be simply the selection of the best crosses 
but, for example, the selection of the best four inbred lines from which 
to form a four-way cross. 

Two other limitations of the present approach should be noted. 
lirstly, we are considering only one property of the crosses, namely 
‘‘vield”. With more than one property, a compromise may have to 
be made and a design chosen that is optimal for one quantity but not 
for another. Secondly, we are considering all crosses among a set of 
inbred lines. Of more interest sometimes would be all crosses between 
two different sets of inbred lines that are chosen to bring together certain 
properties that are present in one set but not in the other. 

The algebra needed to calculate the values of Q for the two methods 
of estimation A and B is very tedious. The comparisons among the 
crosses have to be divided into the three categories: sampled versus 
sampled, unsampled versus unsampled, and sampled versus unsampled. 
Using equations (3.2), (3.3) and (3.4) to sum over these categories, 
we find, 


a, = [{2n(n — 2)sa° + ns* — 2ns — n + 2} 
+ (o2/r)} + {n? — 2ns — n + 2}s0°] 
and 
2 
Qn s(n 2)(n we 1) [{2n(n = 2)sa + 2} {o, + (o%/r)} 


+ {n? — 5n + 2}s07], 
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where a’ is, as before, the diagonal clement of the inverse matrix A7’. 
The value of Q for C, the common tester method, is 


_ 4m — 1) 


where ¢ is the number of common testers, r the number of replicates, 
and o%,,, the variance of specific combining ability among the crosses 
between the inbred lines and the common testers. The quantity 207 
occurs in Qe because the estimate of each cross comparison 7 X j versus 
l X m is biased by the amount s;; — s;,,._ To compare A, B and C for 
the same total number of crosses and experimental plots, we shall 
assume that ¢ = s/2, and that the two values of r are the same. The 
assumption that o?,,, = o? has already been criticized in connection 
with the estimation of o? and o? . However an assumption has to be 
made about the ratio o?,,,/o% and o?,,,/0; = 1 seems the most reasonable. 
Other values could be studied by using the general form for Q- given 
above. 

A comparison between the two methods A and B is immediately 
possible. 


= 


Qc + (62/r)] + 20: , 


2n(s — 2) 
(n — 2)(n+ 1 


As is otherwise obvious, the two methods are identical when s = 2. 
If s > 2, A is preferred to B, i.e. Q, < Qz , if and only if o?/ro? < 1. 
If r > 1, a decision between A and B could be based on an estimate of 
o./ro, obtained from the analysis of variance of Table 1. To compare 
method C with methods A and B, the* values of a° are required. The 
matrix A~* can be easily determined when s = 2 and when s = n — 1 
(the complete diallel cross). When s = 2, A™’ is generated as a circulant 
by the first row 


— forall n and s. 


nn n n 3 n 1 n 1 
24h, 
n 3 n 
and, when s = n — 1, A™ has all diagonal. elements equal to 


(2n — 3)/2(n — 1)(m — 2) and all non-diagonal clements equal to 
—1/2(n — 1)(n — 2). Substituting a® = n/4 in Q, and Q, , we have 
that, when s = 2, 


[(n — 2)(n — + (02 r)} — 


Qs = Q2 =Qce+ 


(n + 1)(n — 2) 
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When n = 3, the complete diallel cross is preferred to common testers 
unless ¢, = 0, when they are equally efficient. When n = 5, the partial 
diallel cross with s = 2 is preferred to using one common tester if and 
only if o2/ro? < 4. When n > 7, using one common tester is to be 
preferred to the partial diallel cross with s = 2 for all values of o7/ro% . 
Substituting a° = (2n — 3)/2(n — 1)(n — 2) in the expression for 
Q, , we have that for the complete diallel cross (s = n — 1) 


4 2 2 
Qs + {(n — + (8n — 5)o;}. 


The complete diallel cross with estimation method B is therefore always 
to be preferred to using (n — 1)/2 common testers. The complete 
dialled cross with estimation method A will be even better if 0?/ro? < 1. 

Values of a° for s intermediate to s = 2 and s = n — 1 are not so 
easy to obtain. An explicit expression for a° is derived in an appendix 
at the end of this paper. Expressions for the other elements of the 
inverse matrix A™' are also derived and may be of use in obtaining 


variances for comparing the yielding capacities of particular crosses. 
The formula for a’ is 


= n 


Values for a° calculated from this formula on an IBM 650 electronic 
computer agreed very well with known values for s = n — 1. The 
agreement for s = 2 and n large was not so good. The values of a” 
for s = 2 in Table 5 were calculated by a®° = n/4. All other values 
were calculated electronically using the formula above. They are 
thought to be sufficiently accurate for our purpose but not necessarily 
accurate to the number of decimals shown. 

Table 6 shows the values of Q, , Q, and Qe for these same values of 
nand s. The first figure for each method is the coefficient in Q of o?/r 
and the second is the coefficient of o? . The bordered squares are those 
in which the common tester method is to be preferred to the diallel 
cross method. They are the squares for which s/n is small. In all 
other squares, the best method is A or B according as o2/ro? is less than 
or greater than o?/ro? = 1. The only exception to this is that when s = 2, 
A and B are equivalent. Also, for each value of n there are, presumably, 
intermediate values of s for which the decision between the diallel 
cross and common testers depends on the unknown value of o2/ro? . 
The examples of this in Table 6 are n = 101, s = 10; n = 50,8 = 7; 
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TABLE 5 
VALUES OF a° FOR VARIOUS 7 AND 8 

101 | 25.25 2.588 “| 9.8332 0.2369 | 0.06515 | 0.02059 | 0.01005 
100 6.031 1.365 0 5530 

75 | 18.75 1.969 0.6523 0 1978 | 0.06027 | 0.02034 

74 4.515 1.044 0.4387 
5 12.75 1 391 0.4836 0.1616 | 0.05575 | 0.02020 

30 3.119 | 0.7514 0 3326 | 

21] 525 | 0.6739 “0.2732 | 0 1162 | 0.05132 
10 0.7689 | | 0.2604 0 | 

9} 2.25 | 0.3721 | 0.1904 | | 

8 0.6458 | | 0.2387 | 0.1548 | | 

| 0.3233 | 0.1833 | | 

6 0.5139 | 0 2250 | 

5] 1.25 2017 | | 

4 0.4167 | | | | | 

3| 0.75 | | | | | | | 

| | 


n = 75,8 = 74; a° = 0.01361; n = 9,8 = 8; a® = 0.1339. 


n = 10,8 = 3;n = 8,8 = 3andn = 5,8 = 2, when the partial diallel 
cross is preferred to common testers if and only if 0?/ro? < 0.25, 0.42, 
0.63, 5.93 and 0.33 respectively. 

For given values of n and o2/o? , Table 6 could be used to compare 
the values of Q, , Q, and Q- for different values of r and s.r will have 
to be greater than 1 if o? is to be estimated and s greater than 2 if o? is 


to be estimated. 


6. Estimation of General Combining Abilities 


The variance of the estimate of the difference between two general 
combining abilities using the partial diallel cross is 
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s IN Q4, Qg AND Qc FOR A RANGE OF VALUES OF n AND 8 
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remaining values are for the second value of n. 


*Values in bold face type are for the first value of n shown for the row 
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V9. — = 2@ — + 
Expressions for a° and a'‘~’! derived in the appendix at the end of this 
paper could be used to evaluate this variance for each pair of values 
of < and j. We shall consider only the average of this variance over the 
n(n — 1)/2 possible comparisons of general combining abilities. Using 
(3.4), this average variance is, 
0 


With s/2 common testers, the variance of all comparisons will be 


— 9) = + (o2/r)). 

Again making the big assumptions that the general combining ability 
of each line with the common testers is the same quantity as the general 
combining ability of each line with all other inbred lines and that 
oe.) = 0, , the average efficiency of the partial diallel cross relative 
to common testers in estimating general combining abilities is E = 
4(n — 1)/(2nsa° — 1). We have taken the total number of crosses 
as well as the total number of experimental plots the same for both 
designs. Values of EF can be calculated from Table 5 and are shown 
in Table 7. When s = 2, EF = 4/(n + 1) and when s = n — 1 (the 
complete diallel crd&s), E = 2(n — 2)/(n — 1). The partial diallel 
cross is very inefficient compared with common testers when s = 2 for 
all values of n above 3. The complete diallel cross is always at least 
as efficient as common testers and tends to be twice as efficient as n be- 
comes large. The partial diallel cross with intermediate values of s 
is often at least as efficient as common testers. If having slightly un- 
equal standard errors for the different comparisons is not a serious 
disadvantage, the partial or complete diallel cross is a better design 
for estimating general combining abilities than common testers provid- 
ing that a sufficient number of crosses can be made so that s/n is a 
reasonably large fraction. Providing s > 2, the standard errors for 
comparisons can be estimated by using the analysis of variance shown 
in Table 1 for the partial (and complete) diallel cross and the usual 
analysis of variance for common testers. 

For a fixed total number of crosses, the partial diallel cross does 
permit more lines to be included in the experiment than does the com- 
plete diallel cross. In selecting lines for general combining ability, 
the resulting increase in the selection intensity will often more than 
compensate for the decreased accuracy with which each line is assessed. 


7. Summary 


A diallel cross among n inbred lines with no parental or reciprocal 
crosses involves a total of n(n — 1)/2 crosses. Clearly, this number 


: 
4 
a 
4 
| 


JO PUODS OY} JO} Bululvuias oy} JOJ UMOYS U JO ONTVA ov UI , 


| 
| | | | OO'T & 
| | | | ost | | 2 | 
| | | E ovr | | oso | 9% 
| | = | vO T | | | £60 | | 8 
| ost | 691 | ost = ort oso | | ott 
| | | | | oor | | 0 | 810 | 06 
| oot | | eet | | | se | | og ‘Is 
| sor | ist | oot | 190 | | cto | soo | 
| ¢ | | | | oF | | 610 | | | ‘tor 
oor | o¢ | Ol | 9 | 4 | u 
; 
| 
= ONINIANOS) ONILVAILSY NI SUTLSAL, NONNOD OL GAILVIAY SSOUD TATIVI(] IVILUVG dO 


247 
| 
| 
| 
| 
| 
| — 
| 
| 
| 
| 
| 
| 
= 
4 a 
, 


248 BIOMETRICS, JUNE 1961 


increases rapidly with n. With limited facilities, this may mean that 
a complete diallel cross can only be made among a rather small number 
of inbred lines. The design presented in this paper allows a large 
number of inbred lines to be studied by performing only a sample of all 
the possible crosses among them. ‘The efficiency of the design for the 
estimation of the variances of the general and specific combining abilities 
of the lines, for the prediction of the yielding capacities of the various 
crosses and for the estimation of the general combining ability of each 
of the lines, is discussed. The design is shown often to be more efficient 
than other designs that have been proposed. 
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APPENDIX 


INVERSION OF Matrix A 


A is a real symmetric circulant matrix and so can be inverted ex- 
plicitly without much difficulty. Consider the general circulant matrix 


5 
An-2 
A : 
a, a2 do J 


Let w; = exp. {j(2mt/n)}, (j = 1,2, --- , n), be the n-th roots of unity. 
Then 


4 
i 
W; W; 
A (ay + ayw, + --- + 
i 


Therefore, the characteristic roots of A are 
=A tau, g=1,2,---,n. (1) 


We can invert these equations to obtain the a’s in terms of the ’s, 


y 
a 
Hy 
¢ 
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and 


Now, A” is also a circulant matrix and has characteristic roots 
1/\;(j = 1,2, --- ,n). Therefore its clements can be written 


1 

Since the matrix A is real and symmetric, its characteristic roots \; 
and the elements of the inverse matrix are both real. Substituting 


and 


Go = 8,0; = Gy = = = = = = = Oand 
= = = = 1 in (1) and taking real parts, 
sin (n — s) 
n 
sin — 
n 
and (3) 
A, = 2s. 
Taking real parts on both sides of equations (2), 


and 
nN At n 


The elements of the inverse matrix can therefore be obtained by 
substituting the equations (3) for the \’s into the equations (4). This 
method was used to compute the values of a° in Table 5. For small 
values of n, the methods available for inverting general matrices may 
be preferable to the special method outlined above for inverting 
circulant matrices. 
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SENSORY TESTING BY TRIPLE COMPARISONS 
G. T. Park 


1’. Hedley and Co, Ltd., Gosforth, Newcastle upon Tyne, England. 


1. INTRODUCTION 


In sensory test work, the number of samples a judge can assess at 
any one time is often limited by sensory fatigue and confusion of stimuli. 
This necessitates the use of incomplete block designs. Turther, the 
difficulty of obtaining satisfactory quantitative measures of treatment 
effects usually entails assessment by ranking. Thus there is need for 
a rank analysis of incomplete block designs of a versatility equivalent 
to that available for variables satisfying the conditions of analysis of 
variance. In addition, any such analysis should provide the experi- 
menter with a check as to whether he can regard the treatments con- 
cerned as lying on a linear scale of acceptability. For, with sensory 
assessment, cases can and do arise where the relations between calculated 
average scale positions disagree with individual direct comparisons. 

These needs have been met in the case of blocks of size two, by the 
various paired comparison procedures developed in recent years [2, 4-6; 
13, 14, 18, 17]. Although this is undoubtedly the most important case, 
instances arise where blocks of size three or more are a practical propo- 
sition and hold out the possibility of increased efficiency. 

Unfortunately, little work seems to have been done in the general 
case of blocks of size k. The result published by Durbin [7] allows an 
overall significance test of treatment differences on balanced incomplete 
block ranking experiments, whilst the rankit method of Fisher [10] has 
been used by some workers, but no generally accepted method (of 
adequate versatility) has been available for blocks of size other than 
two. The method recently published by Pendergrass and Bradley [3, 15] 
which offers a comprehensive treatment of the case k = 3 is therefore 
of immediate interest. 

This paper is to assist evaluation of the Bradley-Pendergrass method 
by contrasting results from triple comparison testing with results ob- 
tained using paired comparisons. Two sets of data are discussed. One 
set is from margarine cocktail stick taste tests, where sensory fatigue 
is known to be marked. The other set is from toilet soap sniff tests, 
where sensory fatigue is much less of a problem. 
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2. BRADLEY-PENDERGRASS TRIPLE COMPARISON ANALYSIS 


The members of each of the (;) triplets formed by the set of ¢ 


treatments are ranked in order of acceptability by n judges.’ Analysis 
proceeds as follows. 


The Model 


The model used is an extension of that successfully developed by 
Bradley and Terry for paired comparisons, [2, 4-6, 8, 11]. It is supposed 
that the treatments 7, , --- , J, are associated with parameters 
™, , , Which satisfy the following conditions: 


t 
x, >0, =1, 


PIT; > T; > = , 
Ain = +m) + + m) + (I, + 7;), 

t#j#k; 1,j,k=1,--- 
where P(T; > T; > T,) represents the probability that in the block 
containing treatments 7; , 7; , T, , treatment 7 is rated top, treatment 
j central and treatment k bottom, in acceptability. 

Maximum Likelihood Estimators of Parameters x; 


The maximum likelihood estimators p, , --- , p, of the parameters 
™,,°** , ™ are given by the equations below: 


=n {[2p.(p; + pu) + + 


Lp =1, t,j,k=1,---,¢ 


where a; = twice the total number of first places + the total number 
of second places given to 7’; and 


Dix = Di(P; + Px) + + pr) + Di(Di + pi). 


In most cases these can be solved by one or two iterations using as 
initial estimates the values of p; found from the quadratic equations: 


pila,(2’ — 6t + 6) — n(2e — 114° + 220 — 194 + 6)] 
+ p,{a(2t — 6) —n(f — + t=1,---, 


1Extension of the analysis to the general case of ni,s rankings on the triplet Ti, Ty, Tz , nine > 0, 
i <j <k,i,j,k =17°°*° t, is readily made and results quoted by the authors in (15]. 
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Variance—Covariance Matrix of Estimators p, 


Expressions for the variances and covariances are presented by 
Bradley and Pendergrass for large n. These are particularly awkward 
to compute, however, and the authors provide an approximation which 
should suffice for practical purposes. If a, --- m, are near equality, 
then 


Cov (V np; V np;) = 2), i¥j, 
Goodness of Fit 

The model can be tested by comparing observed frequencies f;;, 
with expected frequencies f/;, . If f;;, = number of times treatments 
T; , T; , T, were ranked in that order of acceptability, and 

fia = npip;/Diin ; k, i,j,k =1,--- ,2, 

then 


is distributed as chi-square with E@ 1) | degrees of freedom 


for large n. 


Scaling of Treatments 


If the data fit the model, then the authors suggest that the treat- 
ments be regarded as lying at points In p, on a linear scale of accept- 
ability. This is by analogy with the paired comparison model of Bradley 
and Terry. In that case, the parameters 7; can be shown to be related 
to a metric on which the mean response for treatment 7’; is In 7, . 


Overall Tests of Main Effects and Interaction 
An overall test for main effects is available if required. For large n, 
Z= an(4) In6 + 2 a; — 2n In 


is distributed as chi-square with (¢ — 1) degrees of freedom. Il urther, 
if the experiment has been repeated over a number of different groups 
of judges or in different circumstances, interaction can be tested using 
the result that: Z° — Z is distributed as x°(g — 1)(t — 1) where 
Z = >%., Z.,g = no. of groups, Z, = Z above, computed for uth 
group,u=1---g. 
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Relative Efficiency of Paired Comparisons and Triple Comparisons 


Under the assumption that differences observed by judges between 
the three component pairs of each triplet are the same as those which 
would be observed in the equivalent paired comparisons, then the 
efficiency of triple comparisons to paired comparisons is 9/4 in terms 
of incomplete block rankings (or 3 in terms of treatment replications, as 
three assessments are made per triplet ranking against two per pair 
ranking). 


3. PAIRED COMPARISON ANALYSES 


As the various paired comparison procedures give closely similar 
results [1, 12], any one of them could be used as the basis for assessment 
of the triple comparison technique. However, that of Bradley and 
Terry is an obvious choice because of its relationship to the triple 
comparison method. In addition, the results from Scheffé’s method [17] 
are given, as results from this method had to be obtained for routine 
reporting of the paired comparison legs. It must be expected, of course, 
that the results of these two analyses will agree more closely with each 
other than with the triple comparison results, as they are derived from 
the same basic data, whereas the triple comparison data is distinct 
and independent. 


TABLE I 
Resvu.ts or Test I 
Paired Comparisons Triple Comparisons 
Statistic 

Scheffé B-Terry B-Pendergrass 
Response Ratings? ay In ps In pi 
Product A —0.55 —0.42 —0.06 
Product B 0.22 0.28 —0.34 
Product C 0.36 0.43 0.40 
Product D 0.45 0.28 0.50 
Product E —0.48 —0.57 —0.50 
S.E. of Diff. +0.48 +0.52 +0.33 
Goodness of Fit = 2.3 x6) = 5.7 x?(46) = 47.5 
Treatment Difis. =8.2 x4) = 5.7 x*(4) = 13.8 
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4. MARGARINE COCKTAIL STICK TASTE TESTS 


It was found that guidance on the likely results of full-scale con- 
sumer research studies could be obtained by taste testing small cylinders 
of margarine from cocktail sticks. Two such tests were done for routine 
purposes by paired comparisons and for experimental purposes by 
triple comparisons. 

Test I. In Test I, judges examined five margarines A-l. Each of 60 
judges made one paired comparison to give 3 rankings per ordered 
pair. Each of a further 120 judges made one triple comparison to 
give 2 rankings per ordered triplet. 

Test II. In Test II, judges examined three margarines L-N. 
Kach of 138 judges made one paired comparison to give 23 rankings per 
ordered pair. Each of a further 126 judges made one triple comparison 
to give 21 rankings per ordered triplet. 

Paired comparison and triple comparison ratings are seen to be in 
close agreement on Test II. On Test I agreement is not so good, there 
being an indication that the methods give different measures of the 
relative acceptability of Products A and B. The goodness of fit chi- 
squares show that both of the paired comparison models and the triple 
comparison model gave acceptable fits to their respective data. 

On Test II, the relative sensitivity of the three procedures on a 
per ranking basis is indicated by the treatment chi-squares as they 
stand, for the number of pair rankings approximated the: number of 


TABLE 2 


Resutts or Test IT 


Paired Comparisons | Triple Comparisons 
Statistic ——-} 
Scheffé B-Terry | B-Pendergrass 
Response Ratings? ai In pi | In pi 
—_—_--- | - —_ — 
Product L —0.45 —0.38 | —0.44 
Product M 0.55 0.62 | 0.56 
Product N —0.10 —0.21 | —0.12 
S.E. Of Diff. +0.46 +0.58 | +0.41 
Goodness of Fit | =0.0 =0.2 | = 1.3 
Treatment Diffs. | 


x(2) = 4.8 x2) =3.2 | x°(2) = 6.0 


?All sets of response ratings have been adjusted to total zero and range one. 


A 


1 


256 BIOMETRICS, JUNE 1961 


triplet rankings. In the case of Test I, it is necessary to double the 
paired comparison chi-squares before comparing them with the triple 
comparison chi-square, as the number of pair rankings was only one 
half the number of triplet rankings. In each case, there is no indication 
that triple comparisons were more efficient than paired comparisons. 
It is of interest that application of Durbin’s chi-square test of treat- 
ment differences to the triple comparison data from Tests I and II 
gave values close to those found under the Bradley-Pendergrass analysis 
(x7(4) = 13.4, x7(2) = 6.0). 


5. TOILET SOAP SNIFF TESTS 


Two toilet soap sniff tests were done for routine purposes by paired 
comparisons and for experimental purposes by triple comparisons. 
Test III examined four toilet soap perfumes A-D. Each of 132 
judges made one paired comparison to give 11 rankings per ordered pair. 

Each of a further 131 judges made one triple comparison. Although 
the design arranged for rankings to be divided evenly over the 24 
ordered triplets, an error in arranging record sheets resulted in the 
number of rankings varying as follows: (Order of presentation within 


Triplet 
ABC ABD ACD BCD 
No. of rankings 51 17 11 52 


triplet remained in approximate balance). Analysis of this test was 
therefore carried out using the extension of the method to the general 
case when the number of rankings differs between triplets. 

Test IV examined six toilet soap perfumes L-Q. Each of 180 
judges made two successive paired comparisons (involving four differ- 
ent products). As there was no evidence that results from pairs sniffed 
first differed from those for pairs sniffed second, the results for all pairs 
were combined to give a total of 360 rankings, i.e. 12 rankings per 
ordered pair. Each of a further 120 judges made one triple comparison 
to give one ranking per ordered triplet. 

On both tests, paired comparison and triple comparison ratings 
are in agreement within the limits of error. 

On Test III, the paired comparison models fitted the paired com- 
parison data, but the triple comparison model was not a satisfactory 
fit to the triple comparison data (goodness of fit chi-square significant 
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TABLE 3 


Resu ts or Test III 
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Paired Comparisons 


Triple Comparisons 


Statistic - - 

Scheffé b- B-Pendergrass 

Response Ratings a; In ps In p; 

Product A 0.30 0.23 0.30 

Product B 0.44 0.46 0.55 

Product C —0.56 —0.54 —0.40 

Product D —0.18 —0.15 —0.45 

S.E. of Diff.’ +0.42 +0.50 +0.31 

of Fit =0.3 x3) = 0.2 x°(17) = 40.1 

Treatment Diffs. x3) =7.2 x%(3) = 4.5 x3) = 16.5 


3An average value is given for the S.E. of difference of triple comparison ratings as this figure 


TABLE 4 


or Test IV 


varies between pairs of products due to differing numbers of rankings per triplet. 


Paired Comparisons Triple Comparisons 
Statistic 

Scheffé B-Terry B-Pendergrass 
Response Ratings ai In pi In pi 
Product L 0.30 0.37 —0.04 
Product M —0.55 —0.45 —0.36 
Product N 0.45 0.30 0.16 
Product O —0.55 —0.63 —0.55 
Product P 0.13 0.19 0.34 
Product Q 0.22 0.22 0.45 
S.E. of Diff. +0.38 +0.29 +0.21 
Goodness of Fit x10) = 5.7 x10) = x?(95) = 76.7 
Treatment Diffs. = 13.5 = x2(5) = 32.8 
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at 1 percent level). On Test IV, all three models fitted their respective 
data. 

Using the treatment difference chi-squares as before to compare 
sensitivity on a per ranking basis, it appears that, on both tests, con- 
siderably greater sensitivity was achieved with triple comparisons than 
with paired comparisons. (Note that on Test IV the number of triplet 
rankings was only one-third the number of pair rankings so that the 
triple comparison chi-square requires multiplication by three before 
contrasting with the paired comparison chi-squares). Application of 
Durbin’s test of treatment differences to the triple comparison data 
from the balanced test, Test IV, gave x7(5) = 31.5 in good agreement 
with that found under the Bradley-Pendergrass analysis. 


6. ANALYSIS OF VARIANCE-TEST III 


As the extension of the triple comparison analysis to the case of 
varying numbers per triplet was not available at the time, the triple 
comparison results from Test III were analysed by least squares [using 
dummy variables [16]]._ As shown below, the results agreed very closely 
with those subsequently found by the triple comparison method. 


Products S.E. of Treatment 
A B C D Diff. x7(3) 
Triple Comparison 0.30 0.55 -0.40 —0.45 +0.31 16.5 
Least Squares 0.32 0.54 -—0.40 —0.46 +0.31 | 


7. DISCUSSION AND SUMMARY 


These results suggest that the model on which the triple comparison 
analysis is based will prove appropriate to at least a proportion of 
sensory tests. l'urther, that in those cases where sensory fatigue is 
not marked, it may afford a valuable gain in efficiency over paired 
comparisons. It is pointed out, however, that each of the experiments 
described above compared products which were basically similar and 
which differed essentially in only one dimension. 

In the author’s experience, paired comparison tests involving treat- 
ment differences of this nature rarely give results inconsistent with the 
various paired comparison models. Lack of fit tends to occur when 
treatments differ importantly in more than one dimension or when 
marked judge X treatment interactions are likely to be present. As 
the triple comparison model is likely to be more vulnerable than the 
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paired comparison models to the complications arising on these latter 
types of test, it may prove of limited applicability where treatments 
differ in kind rather than in degree. 
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RAPID CHI-SQUARE TEST OF SIGNIFICANCE 
FOR THREE-PART RATIOS’ 


E. Gates AND BENJAMIN H. BEARD? 
Universily of Minnesota, St. Paul, Minnesota, U.S.A. 


INTRODUCTION 


In the study of qualitative characters, the number of individuals 
distributed among mutually exclusive categories is commonly com- 
pared with a distribution predicated on genetic theory. If the observed 
numbers in the various classes deviate from the theoretical, it is de- 
sirable to be able to reject the hypothetical distribution at a determin- 
able probability level. A statistic normally used in ascertaining this 
goodness-of-fit is chi-square. Frequently, the number of such com- 
parisons may be large and the computations necessary for each segre- 
gating family become laborious. In these instances an accurate, fast 
technique would prove useful. This paper presents a rapid, graphical 
procedure for testing goodness-of-fit to ratios with three classes. These 
graphical chi-square tests of significance are particularly appropriate 
for testing lack of fit to three-part ratios for those organisms where it 
is feasible to take random samples of some constant number of indi- 
viduals from segregating progenies. However, by constructing a series 
of graphs, it is practical to use this method with variable sample size 
if the number of uses is sufficiently large. Graphs to be used with 
the 1 : 2:1 ratio have been drawn for a variety of values of n and have 
been used successfully in the field for determining lack of fit. 

Although the justification for, as well as the illustrated examples, 
have been drawn from genetics, uses in other fields can be visualized. 
One particular application outside the field of genetics could be in 
evaluating the results of a sample survey where a response can be 
categorized into three mutually exclusive classes and one is interested 
in ascertaining the goodness-of-fit to a 1:1:1 ratio. 


ILLUSTRATION 


Suppose the numbers of individuals falling in three mutually ex- 
clusive classes are 7, , 7 and x; , where 


(1) 


1Paper No. 4346, Scientific Journal Series, Minnesota Agricultural Experiment Station. 
2Crops Research Division, Agricultural Research Service, U.S. Department of Agriculture. 
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The critical region for a particular level of significance can be defined 
by an ellipse drawn on rectangular coordinate paper with z, and 2, 
(or z;) the ordinate and the abscissa, respectively. Figure 1 was pre- 
pared for the 1:2:1 ratio, the three ellipses indicating demarcation 
between the .10, .05 and .01 levels of significance. 

To illustrate the use of this graph, suppose the segregates from 
individual F, plants from a cross of two barley varieties differing in 
number of rows of kernels on the spike are classified and counted. In 
a cross of this kind (two-row VV X six-row vv) the heterozygote (Vv) 
is phenotypically distinguishable from either homozygote and, if con- 
ditioned by one gene, the F, should segregate in a 1 :2:1 ratio. Con- 
‘sider the following examples wherein 2, , x, and x; refer respectively 
to the numbers in the VV, Vv and vv classes: 


Example X3 n 
1 20 16 14 50 
2 16 22 12 50 
3 7 33 10 50 
4 15 33 2 50 
| 


Locating the points:of intersection of x, and x, (or 2; and x2), as measured 
along the abscissa and ordinate, respectively, the probabilities from the 
x’ statistic can be immediately ascertained as .05 > P > .01, P > .10, 
10 > P > .05 and P < .01 for examples 1, 2, 3 and 4, respectively. 


THEORETICAL DEVELOPMENT FOR AN ARBITRARY 
THREE-PART RATIO 


Genetic theory or other considerations predicate that three classes 
corresponding to those indicated by (1) should have the proportions 
™, , %; and 7; , respectively. It can readily be seen that 


E(z,) = nx, , Var (x,) = — Cov (a; ,2;) = (2) 
It is well known (see, e.g., Cochran [1952 ]) that 


-1 
— 2 — NT. 
will be distributed asymptotically as chi-square with 2 degrees of 
freedom. Expression (3) may be re-written as 
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Now (4) is algebraically identical to the chi-square goodness-of-fit 
statistic 


X20 = [(x; — = x; | (5) 


indicating, incidentally, why the latter has its well known distribution. 
Equation (5) can therefore be seen to represent an ellipse, not in 

standard form, in the x, , x, plane, with the center at 
(nm, , nm). (6) 


The acceptance region of the usual goodness-of-fit test is the region 
inside this ellipse. 


In order to plot ellipse (5), it is necessary to determine the slopes 
of the minor and major axis as well as their lengths. If the x, , x, axes 
are rotated so that ellipse (5) will be in standard form, the slope of 
the rotated x, axis is 


m=R+ VR +1 (7) 

where 

Rotating the ellipse, (5) can be written 

— nt)’ + [C(x /X2,al = 1 (8) 

where 
A = [r2(1 m,(1 4. m’), (9) 


The semi-diameters of the minor and major axes are therefore 


X2,a/ VA, X2.0/ VC, (11) 
respectively, where A, C > 0. 
The slope of the rotated axis, as indicated by (7), is independent 


of sample size, n, as well as significance level. On the other hand, the 
location of the center of an ellipse, as shown by (6), is a function of n, 
but is independent of significance level. The lengths of the major 
and minor axes, given by (11), are a function of both sample size and 
significance level. Hence a family of ellipses with a common center 
and slope can be constructed for given n by varying significance level. 
In using these ellipses, it is recommended that the expected number 
in any class be the customary minimum of 5 or 10 because the distri- 
bution of (3) is only asymptotically distributed as x’. 


te 
q 
f 
e 


BIOMETRICS, JUNE 1961 


CONSTRUCTION OF ELLIPSES FOR THE 1:2:1 RATIO 


Substitution of 1/4, 1/2 and 1/4 for x, , 7, and x; , respectively, 
yields the following basic quantities: 


R = —1/4, m = 0.780776, 1+ m’ = 1.609612, 
A = 11.123103/n, C = 2.876897/n. 
Making use of (6), the center of the 1 : 2:1 ellipse, is located at 
(n/4, n/2). (12) 


Substituting the basic quantities in (11), one-half the lengths of the 
minor and major axes are found to be 


2998-V/ nx... and .5896-Vnx2., (13) 


respectively. An ellipse can be readily constructed for each n in the 
range of interest using a Dietzgen ellipsograph or various simple, but 
accurate construction techniques such as the concentric-circle method 
for major and minor diameters. French and Vierck [1958], a recent 
reference, demonstrate various methods of ellipse construction. 

To illustrate the procedure more specifically, consider ellipses for 
n = 50, where the critical regions are defined by the 0.10, 0.05 and 
0.01 levels of significance. Making use of (12) and (13), one obtains 
These ellipses were plotted in ligure 1. 


Significance Slope of Location of center Semi-diameter length 
rotated 
axis 


781 


CONSTRUCTION OF ELLIPSES FOR OTHER THREE-PART RATIOS 


Calculation of ellipses for defining critical regions for other three- 
part ratios can be carried out in analogous fashion to the ellipses for 
the 1:2:1 ratio. To eliminate the necessity of deriving intermediate 
calculations, the slopes, center, and lengths of major and minor diam- 
eters for some of the more common three-part genetic ratios and the 
1:1:1 ratio are given in Table 1. These quantities are expressed in 
terms of arbitrary n and significance level. To obtain figures for graph- 
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.10 12.50 25.00 4.55 8.94 
05 12.50 25.00 5.20 10.22 
01 12.50 25.00 6.43 12.65 
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x, or xX, 


FIGURE 1 
x? TEsT FoR A 1:2:1 Ratio 


x1, 22 and x3 are the observed numbers of progenies in the VV, V>v and vv classes, respectively. 
Intersection of 21 and z2 (or x3 and z2) outside an ellipse indicates significance at the P = .01, .05 and 
-10 levels of significance for sample size n = 50. 


TABLE 1 


Stopes, CENTERS AND SEMI-DIAMETERS OF EXLLIPSES DEFINING CRITICAL 
REGIONS FoR Various THREE-PART Ratios. 


Genetic Slope of minor 

Ratio* axis of ellipse Center Length of semi-diameters 
relative to x2; 
axis 


3:9:4 0.650 3n/i6 9n/16 0.2890¢ 0.5610 
6:9:1 0.973 3n/8 9n/16 0.1716 0.6720 
3:9:3 0.721 n/5 3n/5 0.2716 0.5710 
3:9:1 0.895 3n/13 9n/13 0.1860 0.5970 
3:12:1 0.883 3n/16 Sn 0.1686 0.5580 
1:14:1 0.638 n/16 8 0.1546 0.3808 
1:331 0.781 n/4 n/2 0.3000 0.5900 


1.000 n/3 n/3 0.4088 0.4080 


*7. was written as the largest component of each ratio. This is somewhat at variance from usual 
genetic terminology. 
tnon-genetic 


= Vn X2,a 
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ing, it is necessary only to substitute n and x3,, and to plot the ellipses 
as previously described. lor three-part ratios not shown, it is necessary 
to substitute appropriate values for x, , 7, , and zs; in (6), (7), (9) 
and (10). 

It would be possible to rewrite (4) in terms of the proportion 
p; = 2,/n, resulting in corresponding changes in the above results. 
For a given genetic ratio and significance level, a family of ellipses 
could then be constructed with common center, the larger samples 
leading to the smaller ellipses. Such graphs would prove in some re- 
spects more convenient to use than the procedure outlined above. 
However, this convenience would in some instances, be offset by the 
requirement of the calculation of two of the p; in order to determine 
the level of significance. The decision as to the better procedure de- 
pends on whether it is more desirable to have a minimum of separate 
graphs, but require supplementary computations, or to have more 
graphs with no computation necessary. Separate ellipses in either 
instance need not be constructed for each n as ellipses for n of similar 
size will be similar. : 

We are indebted to a referee for pointing out a more elegant approach 
to the derivation of the characteristics of the chi-square ellipses and to 
Donald Richter for helpful comments. 
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GENERATING UNBIASED RATIO AND REGRESSION 
ESTIMATORS 


W. H. 


Bell Telephone Laboratories, Incorporated 
Murray Hill, New Jersey, U. S. A. 


1. INTRODUCTION 


Information collected on a concomitant variate is often used in 
finite sampling theory to create more precise estimators of population 
characteristics. This supplementary information is obtained in addi- 
tion to the characteristic under study and some aspects of it may be 
derived from sources other than the sample itself. It may be either 
qualitative or quantitative. For example, suppose that the variate 
under consideration in a sample survey is the number of dairy cattle 
per farm y and that at the time of the survey the number of grazing 
acres per farm z is also obtained. It may then be known from census 
data that the total number of grazing acres in the entire area is Nux 
and the mean per farm is nx . Analytically, we have a random sample 
of n pairs (y; , «;), 7 = 1, --- , n, from a population of size N and the 
population z-mean is known exactly. The problem is to estimate the 
population mean py . 

A general class of estimators designed to utilize this supplementary 
information includes ratio and regression estimators. These estimators 
are described in textbooks on the subject, see for example Cochran 
[1953]. Additional developments have been presented by Hartley and 
Ross [1954], Nieto [1958] and Robson [1957]. 

The two classical ratio estimators are the ratio of means estimator 
i = (9/#)ux and the mean of ratios estimator 7 = ux >."., r;/n where 
gj and # are sample means and r; = y;,;/z,;. It is well known that these 
estimators are biased. The usual regression estimator is obtained by 
evaluating the least squares line of best fit y = 7 + b(x — #) at the 
point wx giving 7, = 7 + b(ux — #) as a regression estimator of py . 
This estimator is biased if the assumption of a linear model is not valid. 

The gencration of some exactly unbiased ratio and regression esti- 
mators is discussed in this paper. Specifically, we classify an estimator 
as of the regression type if it is invariant under location and scale 
changes in x and if it undergoes the same location and scale changes 
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as the y variate. A ratio estimator has analogous properties but for 
scale changes only. 


2. DERIVATION OF UNBIASED ESTIMATORS 
FOR SIMPLE RANDOM SAMPLING 


To generate unbiased estimators, consider the following sampling 
procedure. At step one, select with equal probability one of all possible 
splits of the population into s mutually exclusive groups of size’ n/k, 
i.e., N = sn/k. At the second stage, select randomly without replace- 
ment k of the groups from the total number of groups s of that particular 
split of the population. This gives a sample of size n. 

Now consider the conditional distribution for a particular set of s 
groups. Attached to each of these groups there are characteristics’ 


=, i = 1, --- , s, where and are means of the n/k 


units in the group and b“” is as yet an unspecified function of the y and 
x of that group. For a given split and a random selection of groups, the 
expectations of 7° and z#', i = 1, --- , k, are wy and py respectively; 
that is, they are ert, unbiased. Furthermore, 


745 5 - - (1) 


i=1 


is an unbiased estimator of Cov where 6 = b'/k. 
Hence if g = g + b(ux — 2) then E(g) = uy — Cov (6, #) and 


is a conditionally unbiased estimator of wy . It is then unbiased un- 
conditionally. 

This approach is valid for any defined form of the coefficient b‘’; 
T, will remain unbiased. If b“’ has a form which is invariant under 
linear x and y transformation (say least squares form) then 7’, is classi- 
fied as a regression estimator. If b‘? = g°’/# (say), then 7’, falls 
into the class of a ratio estimator. 

This procedure is used to generate the unbiased estimators; in 
practice a simple random sample would be drawn and to compute 7’, 
it would be split randomly into groups, see Section 7 for an example. 
The latter operation is equivalent to the generating procedure which 


allows a particular split-sample to arise in (*) (N — n)!/[(n/k)"* 


1Jt is assumed that this relationship is true in terms of integers. 

*Superscripts will be used to specify the groups. They will be used with parentheses when the 
reference is to the entire population of s groups and without parentheses when referring to the sample 
of k groups. 
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ways while splitting the simple random sample allows a particular 
split-sample to arise in only one way. The unbiasedness is preserved 
by either procedure. 


The argument is easily generalized to p auxiliary variates. 


3. SPECIFIC ILLUSTRATIONS IN SIMPLE RANDOM SAMPLING 


A form of interest is 


n/k 

i=1 


the least squares slope form. 

In this case 7, bears much resemblance to 9, and might be thought 
of as possessing an additional component which is required to compen- 
sate for possible bias in g, . This is not exactly true of course, because 
the first two terms of 7’, are not exactly the two terms of g, . However, 
in this case (3), it seems natural to make some remarks on the efficiency 
of 7, . 

The variance of 7, depends very much on the form of the b‘” 
coefficients. In fact, until the form of b“” is specified little can be 
said about the variance of 7. One can imagine choices which would 
lead to poor efficiency indeed. However, 7’, in this case has coefficients 
in the least squares slope form and it is natural to ask how it compares 
with 7, when a linear model is assumed, for then #, has optimum variance 
properties. But with this assumption, %, also possesses unbiasedness 
and the advantage of 7’, is unbiasedness in situations in which 4%, is 
not unbiased. However, one would like the efficiency of 7, to compare 
favorably even in this linear model case. So by assuming a linear 
model and a normal x-distribution, it is easily found that V(g,)/V(T,) = 
(n — 2)(n — 6)/(n — 3)(n — 4), k = 2andn > 6. This expression 
is less than one but approaches one as n gets larger and, for example, 
when n = 15, 25 is equal to 0.89 and 0.95. Thus we see that one does 
not lose all the efficiency brought about by the use of an auxiliary 
variate and that [V(7',) — V(%j)]/V(%) is O(n"). 

Turthermore, the role of k also depends upon the choice of the b"?. 
For example, in the special case of the previous paragraph, if the number 
of groups is regarded as variable, V(g,)/V(7,) will be found to have 
a maximum at k = W/n/3. Thus for this form of the b“’, the optimum 
number of groups is Wn/3. Other forms of the b“ would yield other 
results. 

Another possible choice is 
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n/k n/k 


7=1 
In this form 7’, is a ratio estimator and it is unbiased even if the linear 
relationship of y and x does not pass through the origin. But character- 
istically the variance will be inflated by such a relationship. 


Next, if Bb? = 9°?/# = r™, 7, will reduce to the form 
Nk—-n ,._.,. 


where 6 is denoted 7. It will be noted that when k = n, T, = y’, the 
unbiased ratio estimator presented by Hartley and Ross [1954]. The 
efficiency of this form of 7’, has been examined in detail by Goodman 
and Hartley [1958] and Robson [1957]. Robson presents an exact 
variance formula for finite populations. 

Finally, consider = = (k/n) r; , = , then 
6 = # = >°*., r,;/n which does not depend upon the particular split 
of the population. Now if, after substitution of this form into T, , 
the estimator is averaged over all possible splits of the sample into 
groups of size n/k it will be found that the result is again the Hartley- 
Ross unbiased ratio estimator. This averaging process is indicated 
by a star, i.e., T% . 

Other forms could, of course, be considered. 


4. STRATIFIED SAMPLING 


Since a bias may be magnified relative to the standard deviation, 
stratified sampling may perhaps be regarded as the most important 
application of unbiased estimators. Their separate use within strata 
requires exact knowledge of the population strata means but is straight- 
forward. We now develop a combined stratified estimator. 

Consider L strata of size N, ,t = 1, --- , L with a N, = N, 
and again consider the sampling in two stages. At the first stage select 
with equal probability one of the possible splits of each stratum into s 
groups of size n,/k,t = 1, --- , L. Then N, = sn,/k. At the second 
stage select k groups with equal probability and without replacement 
from each of the strata, giving a sample of size n, in the ¢-th stratum, 
= 7. 


For a given split and a random selection of groups 
L L 


are unbiased estimators of py and ux respectively, where 7} and 2; 
denote means of the i-th group in the ¢-th stratum. Also we can consider 


= 
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a coefficient b{) which is as yet unspecified in form but utilizes the set 
of elements in the 7-th group of all strata. For example, 
nt/k 


L 
(2,; — 


t=1 j=1 


(i) 
by: 


is an over-all slope estimator. 
Next we note that 


L k 
where g, is the mean of the n, observations in the ¢-th stratum 


(similarly for ¢,,) and finally that a conditionally unbiased estimator of 
Cov , is given 


t=1 


Consequently, if g = + ba(ux — then = wy — 
Cov (6,, , and therefore 


= Vat + b.(ux 


is a combined stratified unbiased estimator of uy . Note that since 
N, = sn./k, k/s = n/N. Nieto [1958] discussed the efficiency of the 
estimator (7) (for sampling with replacement) in detail. 
Again the generalization to p auxiliary variates is straightforward. 
As a specific illustration consider the case in which 


(i) 


Then reduces to 


In the special case that N, = N,n, = “forall tandk = ”,s = N then 
4 — 1)’ 
(i — 1)N 
which is a generalized Hartley-Ross estimator. 


Finally, we again consider an averaging of 7’, over all possible splits 
of the sample into groups of size n,/k, t = 1, +-- , L. For this, the 


= + 


(Gor — Faker), (9) 
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coefficient is taken in the form = = (N,/N)r\” where 
ri? = (k/n,) (y;/x;). Therefore, 


k L ne L 
/ k= DWN) = 
t=1 2=1 t=1 


and some algebraic reduction will show that 7...) averaged over all 
possible splits is equal to 


= + Gee — + (i - 5 , (10) 
t=1 4 
which does not quite reduce to a form similar in appearance to Equa- 
tion (8) and the Hartley-Ross estimator. 
As before other selections of coefficients will yield other unbiased 
estimators. 


5. MULTISTAGE SAMPLING 


We consider a population with N primaries of equal size M and the 
following sampling scheme. First select n primaries from the N avail- 
able with equal probability with or without replacement. Then select 
with equal probability one of the splits of each of the primaries into s 
groups of size m/k. Then with equal probability and without replace- 
ment draw k of the groups so that the sample size is m in each selected 
primary. 

Consider now the conditional distribution for a fixed set of primaries 
and a fixed split of the primaries into s $ groups eac ‘h. Then by Section 4, 
Equation (11) is an unbiased estimator of Y,, , the population mean of 
the n selected primaries. 


where 


= (k/nm) 9 = DG = nm) 


=1 i= 


~ 


and similarly for x. The coefficient b“” is again arbitrary in form. 
Finally, the expectation of 7:4) over all possible primary selections 
is the average of Y, over all possible primary selections; this is uy and 
T..) is unbiased in multi-stage sampling. 
Again the selection of the coefficients yields estimators of different 
types. For example, an unbiased ratio estimator of the Hartley-Ross 
type generalized to multistage sampling can be obtained. 
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6. VARIANCE ESTIMATION 


It is interesting to notice that the same two-stage sampling scheme 
can be used to form an estimate of the variance of 7, . First assume a 


negligible n/N (or k/s) and a fixed set of uncorrelated groups. 7, can 
now be written 


1 
T= — oy) (12) 
and its conditional variance can be expressed in terms of the variances 
and covariances of the components in (12). Since 7, is conditionally 
unbiased this variance has expectation equal to the over-all variance. 
Substitution of unbiased estimators for each of the terms of the variance 


(plus some terms of zero expectation) yields (13) as an unbiased esti- 
mator of the variance of 7, . 


2 


Although this procedure is unbiased it can be subject to high sampling 
error, particularly for small k. 


TABLE 1 
A OF THE ESTIMATORS 
| r | 
Sample Pairs in | 
Number Sample 7] | Split 1 Split 2 Split 3 T% 
1 P,P2P3P. 3.500 7.167 6.667 | 6.500 6.778 
2 P,P.P3P; 5.250 | 8.917 8.250 | 7.917 8.361 
3 P\P2P;P, | 7.500 | 11.000 | 10.167 | 9.667 | 10.278 
P,P 2P4P¢ 8.750 11.917 10.250 9.917 10.694 
5 6.500 10.000 8.667 | 8.500 9.056 
6 P2P3P.P3 7.500 8.167 7.667 7.500 7.778 
q P2P3P3P 11.500 10.000 8.667 8.500 9.056 
8 P2P3P«P 9.750 9.417 8.750 8.417 8.861 
9 _ 7.250 9.417 8.750 8.417 8.861 
10 9.500 11.000 10.167 9.500 10.222 
ii P\P3P3P.¢ 11.250 11.917 10.250 9.917 10.694 
12 P3P.P3P 13.500 7.167 6.667 6.500 6.778 
13 P,P.P;P.¢ 12.500 11.000 10.167 9.667 10.278 
14 12.750 8.917 8.250 7.917 8.361 
15 P,P.P;P¢ 10.500 13.167 10.667 10.500 11.444 


= 

k(k = 1) 
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7. NUMERICAL ILLUSTRATION 


To illustrate 7, a small population consisting of the six pairs 
P, = (y; ,2;),t = 1,2, , 6, with y = 2’ andz, = 0,1,2,---.5 
was completely examined. Table 1 presents the values of 7, T, and 7% 
{using Equation (3)] for all possible samples of size four. For 7, , each 
of the possible samples was split into two groups of two in all possible 
ways, and the value of 7, was computed for each. The three distinct 
values of T, for each sample are presented in the table. The numbering 
of the splits within a sample is of course arbitrary. It is readily veri- 
fied that the average value of each of 7, T, and 7 is the population 
mean wy = 9.167. Furthermore, the exact population variances of 
g, T, and T* are 7.914, 2.281 and 1.886 respectively. 

As a second example, the six pairs (y; , z;) were taken as follows: 
(0,2), (1, 3), (2, 5), (4, 9), (8, 14), (9, 15). All possible samples of size 
four were drawn and for each sample 9g, y’, % , T, (for all possible 
splits) and 7* were computed. A summary of the computations is 
presented in Table 2. 


TABLE 2 
ILLUSTRATION OF RELATIVE EFFICIENCIES 
Estimator 
Expectation 3.937 4.000 3.961 4.000 4.000 
Bias —0.063 0.000 —0.039 0.000 0.000 
Variance 0.120 0.233 0.027 0.033 0.022 
Mean Square Error 0.124 0.233 0.029 0.033 0.022 
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A BIOMETRIC THEORY OF MIDDLE AND 
LONG DISTANCE TRACK RECORDS’ 


Matcoum E. TurNeR AND ELEANOR D. CAMPBELL 
Medical College of Virginia, Richmond 19, Virginia, U. S. A. 


1. Iniroductory Remarks. 


It has been often observed that a plot of average velocity against 
distance or time for world track records suggests a continuous monotonic 
underlying relationship. Several attempts to discern the nature of this 
relationship empirically by seeking linearizing transformations have 
been made with varying degrees of success. ‘The purposes of this 
paper are to describe an attempt to explain the observed curve by a 
biometric theory and to consider the problem of estimating unknown 
parameters occurring in the theory. The theory is applied to world 
record data of 1959 and records which are below par are pointed out. 
The development is based on the work of A. V. Hill [1927]. 


2. Biometric Theory. 


Consider the situation in which a runner runs a given distance x in 
a certain time ¢ at a constant speed #, this constant speed not necessarily 
being the runner’s maximum speed. We further define: 


y, the total energy (measured as volume of oxygen) excess over 
resting required to run the given distance with the given con- 
stant speed, 

%) , the greatest speed for which the energy (oxygen) required is 
not greater than the energy available for an indefinitely long 
period of time. Thus, at speed # the energy required is equal 
to the maximum amount of oxygen which can be brought into 
the body from the atmosphere, 

r, the maximum excess (over resting) rate at which oxygen can be 
brought into the body from the atmosphere, 

D, the maximum tolerable oxygen debt beyond which complete 
exhaustion is manifest. 


The total excess energy y is a function of the constant speed ¢ and 
the time of the race ft. We assume that the rate of consumption of 
energy (oxygen) dy/dt is a function of ¢ but not of ¢t. Thus, 


1Read before the spring meeting of ENAR, April 1960, and based in part on a Ph.D. thesis super- 
vised by Robert J. Monroe and H. L. Lucas, Jr., North Carolina State College, 1959. 
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dy/dt = f(z) and y = f(a). 


The constant of integration is taken to be zero since no excess energy is 
required to run a race of zero duration. 

The function f(z) is of unknown form; however, we expect it to have 
at least the following characteristics: 


(1) f(z) is a non-decreasing function of 
(2) f(z)-has lower-order derivatives which vanish at the equilibrium 
velocity 


(3) f(%o) 


The first characteristic has been experimentally demonstrated by Hill 
{1927]. The second characteristic, although not experimentally demon- 
strated, seems plausible by analogy with other physiological equilibrium 
phenomena. It often happens that in the neighborhood of a point of 
equilibrium (here there is an equilibrium between the energy being 
consumed and the oxygen being brought into the cells) that com- 
pensatory physiological mechanisms come into play. It may be that 
circulatory changes or viscosity changes (due to temperature changes) 
provide such compensation in the present case. Whether or not these 
mechanisms are plausible, it seems appropriate to require characteristic 
(2) in the absence of experimental fact since one is hard pressed to 
find any physiological example not possessing this characteristic. 
Characteristic (3) is implied by the definition of % and r. 

Perhaps the simplest function possessing these characteristics is 
the following: 


f(z) =r+ te. (1) 
Then we have 
y =rt + — (2) 


Equation (2) can be used to describe the experimental data shown in 
Figure 11 of Hill [1927]. Hill measured directly the excess oxygen 
required by an athlete to run for given periods of time at constant 
speeds. This experiment, of course, does not correspond to actual 
contest conditions, but does serve to illustrate the relation (2), which 
was not given by Hill. The meaning of the relation is clear. If a 
runner runs at his own asymptotic speed z , then the excess energy 
required is obviously proportional to the time run where the proportion- 
ality constant is r; but, if he runs faster than %, , then the energy required 
will be increased monotonically with the divergence of his speed from 
the asymptotic speed. 


; 
| 
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Now, the speed cannot be increased indefinitely since there is an 
upper bound on energy available. This upper bound is given by 


Ymax = TE+ D. (3) 


For all but the shorter races the time lost in attaining optimum 
speed is negligible and it can be seen that the best time for a race can 
be obtained by maintaining a nearly constant speed throughout the 
race. It may be supposed that records are broken when a runner with 
a great amount of available energy is able to select that constant speed 
which equates the maximum available energy to the required energy. 
In this case 


ri + D =rt + b(t — (4) 


which upon cancelling rt from both sides and rearranging gives an 
equation relating speed to time run. Thus, 


& = + (bt/D)™. (5) 


The constants z) , D, b, and k are constants pertaining to the indi- 
vidual runner. D is the maximum oxygen debt the runner can tolerate 
and b and k relate to the mechanical efficiency of the runner’s body, 
i.e., to the amount of work required to overcome the viscosity of the 
muscles. i is a function of the rate at which oxygen can be gotten 
to the tissues. Relation (5) could be used to study the progress of an 
individual runner in his period of training; however, our interest at 
present is in characterizing the world record curve. Although % , 
D, b, and k are personal parameters, it may be supposed that, for world 
record holders, #) and D approach the human maximum for all and 
that b and k are similarly close to the human minimum for all and that 
therefore it is appropriate to treat 2, , D, b, and k as constant parameters 
for all record holders as a first approximation. Equation (5) is a special 
case of the single process law described by Turner [1959]. 


3. Estimation Theory. 
lor convenience we change the notation. Let: 
Y = 4, 6 = —I/k, 
a=i, 
= (b/D)-“* = (D/b)". 
Then (5) may be rewritten: 


a + BX’. 


gi 
| 
(6) 
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Now, (6) cannot be expected to hold exactly for world records but 
it may be considered to be the limiting curve which is approached by 
the successive records in each event. Thus, for the actual observed 
records, we may write 


Y =a+ (7) 


where e«’ < 1. Perhaps, the limiting curve (6) itself is not absolutely 
stable since the human species is possibly changing in its athletic 
capacities due to nutritional and genetic effects. However, these 
changes may be regarded to take place slowly as compared with the 
rate at which records are broken. 

At any point in time we will assume as a first approximation that 
the distribution of world records below its asymptotic value can be 
described by the truncated hyperbolic distribution:? 


fe’) = W/pe’, Se (8) 


If we substract a from both sides of (7) and take logarithms we 
obtain the linear form: 


log (Y — a) = log 8 + 6 log X + «, (9) 


where « = log «’. Now it will be seen that the additive error « follows 
the rectangular distribution: 


fl) =1/p, -pSe SO. (10) 


Thus, the problem of estimation is reduced to a well known one: to fit a 
straight line when the errors have a rectangular distribution. Maxi- 
mum likelihood estimates are readily found by minimizing the maximum 
error (see Turner, [1960]). The procedure is as follows: 

(a) Choose a trial estimate of a and then plot log (Y — a) against 
log X. 

(b) The line with minimum maximum error will either (i) pass 
through one point such that all other points fall below and such 
that two points will have the same maximum error, or (ii) pass 
through two points such that all other points fall below and 
such that one point will have the maximum error. 

(c) In case (i) the line will be parallel (and hence have the same 
slope) as a line passing through the two points with maximum 
error. The intercept is then found by passing a line with the 
same slope through the upper point. In case (ii) both slope and 


2The truncated hyperbolic distribution was chosen as being, perhaps, the simplest distribution 
producing high contact on the right and having a finite upper limit. Since the upper limit is the ebject 
of estimation, the lower portions of the distribution are relatively irrelevant. 
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intercept are found for the line passing through the two upper 
points. For either case the maximum error is readily ascertained. 
The choice of case (i) or (ii) is quickly made graphically and 
other determinations are made analytically. 

(d) The above three steps are repeated for other choices of a and 
then, from the relation between minimum maximum error and 
a, one interpolates for the maximum likelihood estimate of a. 
Repeating the above three steps one final time with the optimum 
value of a leads to maximum likelihood estimates for 8, 6, and p. 


The above procedure illustrates a general theorem concerning mini- 
mum maximum error approximation by polynomial equations due to 
Vallée-Poussin [1911]. 


4. Fit of Theory to World Track Records. 


The 1959 World records for all events between 400 and 10,000 
meters (including English distances of 440 yards to six miles) were 
used to fit the theory. These data are given in Table I. Shorter 
distances and longer distances bring into play mechanisms unaccounted 
for in the theory, such as delay due to starting, muscle stiffness, blisters, 
nutritional requirements, etc. 

Performing steps (a), (b), and (c) we obtain the following results: 


Minimized 
Maximum Error 


5.08 0.03249 
5.09 0.03190 
5.10 0.03130 
5.11 0.03143 
5.12 0.03183 


Parabolic interpolation between the middle three values in the above 
table yields the value @ = 5.103. Refitting the straight line gives the 
estimates § = —0.4451, 8 = 20.44, and 6 = 0.03115. We then have 
the estimated limiting curve. 


= 5.103 + (11) 


where the estimated asymptotic value of the speed is % = 5.103. The 
estimated limiting speeds have been calculated according to equation 
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(11) and are shown in the last column of Table I beside the actual 
record speeds. Both record and estimated speeds are also shown in 
Figure 1. Although no very long races have been included in the analysis 
it is interesting to compare the speed for 30,000 m., ¢ = 5.26, with the 
estimated asymptotic speed, % = 5.10. 

Estimated times é may be readily found by dividing the distance x 
by the estimated speeds %. These values are shown in column (4) of 
Table I and the differences between these estimated limiting times and 
the actual record times are given in column (5) of the same table. The 
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extent of the agreement is almost startling. The largest discrepancy is 
seen to be just 14.8 seconds for the six-mile run. The time for the mile 
run appears to be relatively good, along with the 400, 5,000 and 10,000 
meter races. With the exception of the mile run the ‘‘English” distances 
tend to lag behind the corresponding ‘‘metric’’ distances. Perhaps, 


this fact reflects nothing more than the popularity of the various dis- 
tances, but one is tempted to speculate that large improvements in 
those races which lag behind may be forthcoming. 
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ADDENDUM 


Since this analysis was completed Sweden's Dan Waern lowered 
the 1000 m. record to 2’ 17.8’’ and Australia’s Herb Elliott lowered the 
1500 m. record to 3’ 36.0’... These are both above the estimated opti- 
mum times for these distances and hence the analysis is not affected. 
However, the fit is substantially improved. 
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SMALL SAMPLE BEHAVIOR OF SLOPE ESTIMATORS 
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1. INTRODUCTION 


This paper is concerned with estimating the slope parameter in a 
linear functional relation between two variables which are not observ- 
able since both are subject to error. Such problems occur in many 
contexts. As a matter of fact, in virtually all applications of fitting a 
functional relation errors of observation occur in all variables. Very 
frequently we can neglect errors in the independent variables in com- 
parison with the errors in the dependent variable, but clearly we cannot 
always do so. In particular, it is often desirable to use a relatively 
inexpensive technique in place of a very costly one, where the results 
given by the two, apart from errors, are linearly related. For example, 
the evaluation of rocket grains by static test techniques is relatively 
inexpensive compared to the procedure of utilizing dynamic or flight 
testing. 

The following linear relation is assumed between the variables X, Y. 


Y=a+t px. 
Neither X nor Y can be observed, but only x and y, where 
z=X+e 
y= Y+f; 


e and f are independent random variables with expectation zero repre- 
senting errors of observations; X and Y are the expected values of z and 
y respectively. When for each X,()’,;) we have a single observation 
z,(y;), we shall say that we have unreplicated observations on that 
variable; otherwise we have replicated observations. 


‘Preparation of this paper for publication was supported in part by contract No. DA-11-022- 


ORD-2059; research supported in part by Air Force Office of Scientific Research, Contract No. AF 
49(639)43. 


20n leave from Iowa State University of Science and Technology, Ames, Iowa, U.S. A. 
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In a previous paper [3] we considered the large sample properties of 
various estimators of the parameters a, 8. In the present paper we 
consider the small sample behavior of these slope estimators in order 
to compare them. First however, we take up the small sample behavior 
of slope estimators which do not require replicated observations; such 
estimators were discussed only briefly in our earlier paper. 

We have chosen to examine the bias and the mean square error of 
the various estimators, partly because of the innate interest which 
these properties hold and partly because they seemed most amenable 
to attack. In all the cases considered the square of the bias is small 
compared with the mean square error; consequently our findings con- 
cerning the latter are essentially valid for the variance as well. 


2. ESTIMATORS WHICH DO NOT REQUIRE REPLICATION 


The problem of estimating the parameters of a linear functional rela- 
tion when both variables are in error and there is no replication has long 
been regarded as an intractable one. In 1940 Wald [10] suggested that, 
when the number of observations n is even, one can divide the observa- 
tions into two equal groups and take as an estimator of 8 


n 4n n jn 
bw =(Su- 
1 1 
He showed that by is a consistent estimator of 6 provided that the 
partition of observations into two groups can be carried out inde- 
pendently of the errors and provided that limit inferior of 


1 (Xa +X ye) — + X,) 


is positive. If the errors in the 2; are small enough so that partitioning 
the observations according to the magnitudes of the x, yields the same 
two groups as obtained by partitioning the observations according to 
the magnitudes of the X, , the first condition is satisfied. The second 
condition guarantees that the expectation of the denominator does not 
vanish. 

Nair and Shrivastava [8], Bartlett [1], and others [4], [9], have shown 
that, for certain spacings of the X, , more efficient estimators of 6 can be 
achieved by dividing the observations into three groups and omitting the 
middle group. In particular, Bartlett suggested that, when the number 
of observations is divisible by three, one should take as an estimator of 8 


(Hu Eu) Ee) 


This is a consistent estimator of 8 under the obvious modification of 


} 
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Wald’s conditions. Bartlett showed that b, is more efficient than by 
when the X,; are equally spaced. 
Housner and Brennan [6] suggest that the estimator 


bn = DG dy./ LG , 

where 7 now denotes the order number when the 2’s are ordered according 
to increasing magnitude, will often be more efficient than any of the 
foregoing. In fact they give empirical results to substantiate the belief 
that by, is more efficient than by when the X, are equally-spaced. It 
should be realized, however, that consistency of this estimator rests 
upon more stringent assumptions than those made by Wald and the 
other writers mentioned above. One must now assume the entire 
ordering according to the magnitudes of the 2, to be identical with the 
ordering according to the X, . 

It is clear that all of the estimators mentioned above are members 
of the class bh = > wiy;/ >» w,«; , Where 7 denotes the order number 
when the 2’s are ordered according to increasing magnitude and 
> w, = 0. One requires this restriction on the w; in order to ensure 
that b, be invariant with respect to translations of the coordinate axes. 
In our investigation of b, we shall make the assumption that the ordering 
according to the magnitude of the x, is identical with the ordering accord- 
ing tothe X,;. If that is so, the w, are simply constants, and b, is the 
ratio of two linear forms in x; and y;. In some fields of research such an 
assumption might be unrealistic, but in the physical sciences it would 
ordinarily be regarded as quite reasonable. In any event, occurence 
of situations where the assumption is reasonable seem sufficiently 
frequent to justify a detailed investigation. 

We propose now to examine the bias and mean square error of b; as 
they relate, in particular, to the choice of the w; . We first set down the 
model and the assumptions which underlie the discussion in Sections 
3, 4, and 5 below. We suppose that 


Y, =a + BX, , t= 1,2, ,n, 


where @ and 6 are unknown parameters while the XY, and ); are un- 
known constants. The X, are assumed to be ordered according to 
increasing magnitude. We observe x, and ¥,; , where 


r,= X,+¢e;, 
Yi Y, + . 


The e, and f; are random variables, representing errors of observation, 
such that 
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(1) e; and e; are independent if 7 ¥ j, 


(2) f; and f; are independent if i ¥ j, 
(3) e; and f; are independent for all 7 and j, 
if (4) E(f;) = Oand = oF = ». 
: (5) Let c = min; | X,., — X, |. Then Prob {| e; | > 4c} = 0. 


That is to say, the e, have finite range, extending from —}c to 
3c. This is the assumption which ensures that the ordering 
according to the 2, is identical with the ordering according 
to the X; . 

(6) E(e,) = Oand E(e}) = of = , E(et) = = ws. All 
odd moments of the e; are zero. 

(7) 7 w,X; ~ 0. It is easily verified that for each of the estimators 
considered this is the case. 


It should be stressed that the e; and f; represent errors of observation 
only since the X,; and Y; are constants, otherwise e; and f; would 
obviously not be independent. As for assumption (5), it also ensures 
that the estimators are consistent, since >> w; = 0. In practice it is 
conceivable that one might wish-to relax assumption (5) slightly to 
permit a distribution with infinite range but with most of the probability 
concentrated in (—c/2, c/2). The extent to which one might relax this 
assumption is not considered in this paper but will be investigated 
subsequently. 


3. BIAS AND MEAN SQUARE ERROR OF b,. 


The bias, B, of b, , may be obtained in the following way: 


E(b,) = E(> 
Now 


1 1 
P+ 


(—1)P“( we)* + 


(—1)'*" (>* 
we, 


where P = 
Consequently, 
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=0 
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where 


D 


It has proved sufficiently accurate for the purpose of this investiga- 
tion to take t = 5. Then 


1 1 1 1 


Since E(>, w.y;) = BP, we have 


E(b,) = + we) + we | + BP D. 


where 


Therefore 


B, = af Me w, + (us + >. wie’ | + BP D. 


In all of the cases studied it is easily verified that 
—1 < >> we;/P < 


Consequently, for the cases we want to investigate it is possible to find 
simple bounds for D. In fact, 


1 


To see this, one need only realize that for negative values of z, We; 


0< / (i + < we)" / (i 


while for positive values of z. We; 


0< we) / (1 + we.) < (w,e;)°. 
Consequently, 


0 ewes” < 1 
| (> wee.) 


+ 
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Therefore 
+1 
2P’ > | w, |e 
‘i 


ix ixixk 


Thus we have the means for approximating the bias to any described 
degree of accuracy, and furthermore, we have a way of assessing the 
accuracy of any approximation. 

It is possible to obtain the mean square error, M, of b; , in essentially 
the same way as B, was obtained. The result is 


1 
My = Dy + (us wi + DU win’) | 
+. 2 3 2 2\2 
Me W; + w;) 


+5 +38 wind | 


+ A, where A = 


and 
27 (, _ > | ( Le | w, 
(i P +; 1+ 5 
P 


4. OPTIMAL CHOICE OF WEIGHTS. 
We should like now to consider two possible sets of w, ; namely, 


1. The set which minimizes the bias B,; , and 
2. The set which minimizes the mean square error M, . 


In general, of course, the two sets differ. The exact specifications of 
either set does not appear possible in view of the complexity of the 
expressions for B, and M,. On the other hand it is possible to obtain 
very good approximate specifications. 

If one chooses the w, according to the scheme of Wald, or Bartlett, 
or Housner and Brennan, max,, | >, w,e; |/P turns out to be consider- 


if 
4 
= 
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ably less than unity, even for values of m as small as four; this is a 
consequence of assumption (5) of Section 2. This leads one to conjecture 
that max | >» w,e; |/P is small for any reasonable choice of the w;—in 
particular, one would expect it to be small for good choices, like that 
which minimizes the bias or the mean square error. If this is the case, 
one would expect the bias and the mean square error to be determined 
primarily by the term of order P~* in the expression for each; conse- 
quently, minimizing that term should approximately minimize the 
bias or the mean square error, as the case may be. Now this term in 
the expression for the bias is u,8P~? ps w, , Whereas the corresponding 
term in the expression for the mean square error is + . 
Obviously both of these terms are minimized by the same set of w;, , 
which is easily shown to be given by w, = (X,; — X)C, where C is 
any arbitrary constant unequal to 0. 

Up to this point we have proceeded heuristically; we should now 
like to show with the aid of some examples that retention of terms in 
P~* makes only a trifling difference in the weights and far less difference 
in the bias itself. 

As the first example, we consider four points: X, = —3c/2, 
X, = —c/2, X; = c/2, and X, = 3c/2. We take wu, = }(c/2)? and 
us = 3(c/2)* which are the moments of the rectangular distribution on 
the interval (—c/2, c/2), which is the maximum possible range conso- 
nant with the assumptions of Section 2. We might equally well consider 
any other admissible distribution on this finite range; the same tech- 
nique would apply; and the results would be substantially the same. 
The condition above gives as the weights w, = —3,w, = —1,w; = +1, 
w, = +3 (or any multiple of these, of course), Minimization of 


1 1 
gives for the w, 


w, = —3.044, +l, w, = +3.044. 


This introduces a relative change in the bias AB,/B, of 9 X 10°. 

As a second example, we consider the four points X, = —5c/2, 
X, = —c/2, X3; = c/2, and X, = 5c/2, with pw, and yw, just as in the 
previous example. The condition gives 


w, = —5, w, = —1, w; = +1, w, = +5. 


Minimization of 


B, = al Me wi + (us wy + > win’ | 
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gives for the w; 
= — 5.034, = = +1, = 5.034. 


This introduces a relative change in the bias AB,/B, = 3 X 107°. 

It will be observed that the perturbations produced both in the 
weights and in the bias by the term in P™ are smaller in the second 
example than in the first. That is exactly what one would expect, for 
although the spread of the X,; has increased in the second example, 
the range of the e; has not changed. This has the effect of decreasing 
max > i w,e;/P, thereby decreasing the importance of the term in 
P~ relative to that of the term in P"*. One might examine the mean 
square error in similar fashion. It is clear that the approximate minimi- 
zation of bias and mean square error given by choosing w; = X; — X 
is a very good approximation, and the estimator by which employs 
these weights can for all practical purposes, be regarded as having 
minimum bias and minimum means square error. We shall refer to 
this choice of weights as optimal and to the estimator 


as the optimal (ratio-of-linear-forms) estimator. 


5. COMPARISON OF VARIOUS WELL-KNOWN ESTIMATORS 
WITH THE OPTIMAL ESTIMATOR. 


In general the spacing of the X, is unknown, and the optimal esti- 
mator is therefore not obtainable. It is customary to use the weights 
of Wald, of Bartlett, or of Housner and Brennan. The corresponding 
estimators will henceforth be denoted by by , bg , by respectively, and 
the corresponding biases and mean square errors will also carry these 
subscripts. For example B, denotes the bias of Bartlett’s estimator. 

When the X, are uniformly spaced, by and bo are identical, which 
is to say that the Housner-Brennan estimator is optimal for this spacing. 
For any other spacing of the X; neither by , bs , nor by is optimal; the 
question is, how far do they depart from optimality. 

To answer this question we have studied the bias and the mean 
square error of these estimators for n = 6, 12 and for various types of 
spacings of the X,; , which may be classified as follows: 


1. Symmetric spacing: --- , —5°p, —3°p, —1°p, 1°p, 3°p, 
5°p, forw > 0 

2. Symmetric spacing: —1°p, —2°p, —3°p, --- , 3°p, 2°p, 1°p 
for w < 0 

3. Asymmetric spacing: 0, 2(1°)p, 2(2°)p, 2(3°)p, --- for w > 1 
and0<w<l 


. Asymmetric spacing: —1°p, —2°p, —3°p, --- forw < 0. 


4 
4 
§ 


we 
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We have taken the values of p to make the ranges of the selected X, 
values approximately the same, ensuring at the same time that condition 
(5) of Section 2 holds. In addition we have taken 


= 3 Me 5 We = 7 
which coincide with the second, fourth, and sixth moments of a rec- 
tangular distribution having the maximum range consonant with the 
assumptions of Section 2. As indicated in Section 4 there is no serious 
loss of generality in confining our attention to a rectangular distribution 


of errors. 
Tables 1 to 5 present, forn = 6 and n = 12, 


1. The bias of the optimal estimator. 


2. The ratio of the bias of by , bs , and by to the bias of the optimal 
estimator. 


3. The ratio of the mean square error of by , bg , and b, to that of 
the optimal estimator. 


The values cited in the tables are correct to within one unit in the last 
place given there. Results for other values of n can be found in Dorff [2]. 


6. LEAST-SQUARES-TYPE ESTIMATOR 


This section deals with bg = — (2; — , which 
is the estimator one would obtain if he minimized the sum of squares 
of deviations in the vertical direction, simply ignoring the fact that the 
az, are random variables. It is well-known that bg is not a consistent 


TABLE 1 


Maximum VALUE oF 


Values of w 
n 2.0 1.0 0.5 —0.5 —2.0 
Symmetric Spacing 
6 .0002 .0048 .0012 .0004 .0008 
12 .0000 .0006 .0001 .0001 .0000 
Asymmetric Spacing 
6 .0002 —_ .0014 .0006 .0000 
12 .0000 .0002 .0000 .0000 


‘For w = 1.0 the pattern of spacing presented would be symmetric; consequently no value is 
cited here. 
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TABLE 2 


Bras Ratio FoR SYMMETRIC SPACING 


Values of w 
1.0 0.5 


TABLE 3 


Bras Ratio FOR ASYMMETRIC SPACING 


Values of w 
0.5 


292 
Ratio 2.0 —2.0 
| By/Bo 1.06 1.00 1.04 1.08 1.10 
. Bw/Bo 1.73 1.30 1.09 1.06 1.74 
Bz/Bo 1.22 1.10 1.14 1.25 1.38 
Bo/Bo —3.00 —2.97 —2.90 —2.99 —2.99 
n = 12 
By/Bo 1.06 1.00 1.04 1.06 1.47 
Bw/Bo 1.78 1.32 111 1.11 2.93 
. Bz/Bo 1.28 1.12 1.15 1.26 2.13 
Bo/Bo —9.00 ~9.00 —9.00 —9.00 —9.00 
Ratio 2.0 . —2.0 
Bu/Bo 1.08 1.10 1.17 1.62 
: Bw/Bo 1.41 1.58 1.69 2.81 
Bz/Bo 1.19 1.27 1.34 2.03 
Bg/Bo —3.00 —~3.00 ~3.00 ~3.00 
n = 12 
Bu/Bo 1.08 1.09 1.32 2.51 
. Bw/Bo 1.43 1.56 2.08 5.24 
Bo/Bo —9.00 —9.00 —9.00 —9.00 
| 
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TABLE 4 


MEAN-SQUARE-ERROR RATIO FOR SYMMETRIC SPACING 


Values of w 


Mu/Mo 
Mw/Mo 
Ms/Mo 
Mg/Mo 


Mn/Mo 
Mw/Mo 
Ms/Mo 
Mg/Mo 


«Because of slow convergence of our approximation techniques for this combination of parameters, 
we have no reliable value to cite here. 


TABLE 5 


MEAN-SQUARE-ERROR FOR ASYMMETRIC SPACING 


Values of w 
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Ratio 2.0 1.0 0.5 —0.5 —2.0 oe 
1.06 1.00 1.04 1.08 1.10 
1.73 1.31 1.09 1.06 1.74 eee 
1.22 1.10 1.14 1.26 1.38 oe 
0.99 0.99 0.99 1.00 
1.06 1.00 1.04 1.07 1.47 
1.78 1.32 1.11 1.11 2.93 is 
1.28 1.12 1.15 1.26 2.13 a 
1.00 1.01 1.00 1.00 1.00 G 
= 
: 
Ratio 2.0 0.5 —0.5 —2.0 j 
n=6 
Mu/Mo 1.09 1.11 1.17 1.62 
Mw/Mo 1.41 1.58 1.69 2.81 ' 
Ms/Mo 1.19 1.27 1.34 2.03 
Ma/Mo 1.00 0.98 1.00 1.00 : 
n = 12 

Mu/Mo 1.08 1.09 1.32 2.51 
Mw/Mo 1.43 1.56 2.08 5.24 : 

Ms/Mo 1.20 1.27 1.61 3.66 

Mg/Mo 1.00 1.00 1.00 1.00 
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estimator of 8; however, it is conceivable that it might have desirable 
small-sample properties. We shall now investigate the bias and mean 
square error of bg , making the same assumptions as in Section 2. 
Tables 2-5 cite values of Bg/Bo and Mg/M, correct to within one unit 
in the last place given there. It will be observed that Bg/Bo is approxi- 
mately —(n — 3) while Mg/Moq is nearly unity. 


7. DISCUSSION OF ESTIMATORS WHICH DO NOT 
REQUIRE REPLICATION 


We should like now to compare the estimators discussed in Section 2 
with a view toward making some practical suggestions for workers 
who are actually concerned with fitting straight-line relations. 

Generally speaking 6b, is clearly superior to by but there are some 
situations when such is not the case; we found that bw had lower bias 
and lower mean square error than b, when the X; are symmetrically 
spaced, with w = 0.5 or w = —0.5. However, in almost every case 
investigated, b, proved superior to by and to bg . This, of course, is 
hardly surprising. The use of b, presupposes through the ability to 
order all the observations more information available to the experi- 
menter than that of by» or b, , and estimators based upon more complete 
information are typically more efficient than those based upon partial 
information. We did, nevertheless, find instances where bw proved 
superior to bg and by, . One of these is n = 6, w = —0.5, symmetric 
spacing. For asymmetric spacings corresponding to these values of 
n and w, by was found decidedly superior to the others. 

As the comparison of by, and bg is slightly more involved, we should 
like to first compare bo with bg . The conclusion seems inescapable 
that when bo can be obtained it is preferable to bg for two reasons: 


1) bo has much smaller bias than bg , while its mean square error is 
essentially no greater. 
2) bo is a consistent estimator of 8, whereas bg is not. 


The difficulty, of course, is that bp cannot usually be obtained, inas- 
much as the spacing of the X, is unknown. 

However it appears that b, is a reasonable substitute for by when- 
ever the X, possess no marked skewness and are not bunched excessively. 
When such is the case we see that neither B,/Bo nor My/Mg will 
greatly exceed unity, while B,/Bg will be approximately —1/(n — 3). 
Thus, when using b, in preference to bg , one stands to do much better 
with respect to bias and very little worse with respect to mean square 
error. 

One could roughly assess the skewness or bunchiness of his data by 


— 
yy. 
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plotting the z; versus 7 on log-log paper; the slope of the line which 
best fits the points is then w. Ordinarily this should not be necessary; 
in most cases one could decide whether there was evidence of skewness 
or bunchiness by merely looking at the data. 


8. ESTIMATORS WHICH REQUIRE REPLICATION. 


We consider now various estimators of 8 suitable when replicated 
observations are available. We suppose that 


Y,=a+ ¢=1,2,--- ,n, 
just as in Section 2, but now we have observations 
Xi 
Ye = Vitfe, 


where = 1,2, --- ,r(r > 1); 


e;, and f;, are random variables, representing errors of observation, 
such that 


1) e,, and e;, are independent unless i = j and t = u. 

2) fi, and f;, are independent unless i = j andt = u. 

3) e,, and f;, are independent for all 7, j, ¢, wu. 

4) Let c = min, | X,4, — X; |. Then Prob {| e,, | > c/2} = 0. 

5) E(e.) = uo, E(et,.) = us, = ws. All odd moments of 
the e;, are zero. 

6) Prob {| fi: | > 3hBc} = 0. That is to say, we now restrict f;, 
to a finite range (—3h8c, 3hBc); the symbol h is defined by this 
relation. 


All odd moments of the /;, are zero. (These assumptions would 
be satisfied if the distribution of the f;, differed from that of 
the e;, only in its range.) 


In our previous paper [3] we considered the following estimators 
of 8, all of which are consistent provided that their denominators have 
non-vanishing expectations: 


where 
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r 


r 


and sgn 8 = +1ifB>0 
<0. 


We have applied the techniques of Section 3 to the study of the bias 
and mean square error of these three estimators for comparison with the 
bias and mean square error of bop = (X; — X)y.J/(D> (X; 
We found that b, , b, , b; and bo have approximately the same mean 
square error but that their biases can differ greatly. In fact, when the 
errors are sufficiently small B,/B,) = 2, B,/Bo = 1 — h’, B;/Bo = 
(3 — h’)/2. Thus, the absolute bias of b, is smaller than that of b, 
whenever h > 1/3 ; the absolute bias of 6; is smaller than that of b, 
and b, whenever 4/5/3 < h < V7. Now = and since 
v2/p> is ordinarily unknown, we are unable to decide whether 4/5/3 < 
h < V7 ornot. This would seem to rule out b; as a useful estimator 
of 8. On the other hand in many problems it might well be possible 
to decide whether h > +/3 or not. Inasmuch as b, and b, have approxi- 
mately the same mean square error one could then use the bias as a 
criterion for choosing between the two: i.e., 


When p< use ; 


When pt > use b.. 


It is interesting to note that analysis of the asymptotic variance of 
b, and 6, in our previous paper [3] led us to recommend that 


when < V2/ use b, 


when 8° > , use 


so that the large sample approach based on variance and the small 
sample approach based on bias lead to somewhat different conclusions. 

For values of h larger than +~/2, bp would be preferable to b, , but 
unfortunately bo is not usually obtainable. We could, of course, use 
by , bw , or bg in lieu of b, at some sacrifice of efficiency, but with a 
corresponding reduction of the magnitude of the bias. If one knew 


: 
a 
* 
% 
i 


BEHAVIOR OF SLOPE ESTIMATORS 297 


something about the spacing of the X; , this might be a desirable way 
to obtain an estimate of 8, but if nothing is known about the X, , it 
seems advisable to use either b, or b, . In any case the use of b, or b2 
does not require any assumption about the possibility of ordering the 
observed values correctly in contradistinction to the estimators 
by, bw,bs,0rbo. 


9. CORRELATED ERRORS 


In some investigations it would not be reasonable to assume the 
errors e; and f; to be independent; one should properly take account of 
correlation in such cases. The correlation of errors greatly increases 
the complexity of the problem and an examination of small sample 
properties for such situations has not been included here. 

We have, however, examined in [2], [3] the asymptotic variance for 
consistent estimators of 6 when the errors are correlated. In this case, 
the estimators b, , b, , and b; are modified as follows in order to retain 
the property of consistency: 


bs = V(B,, — W,,)/(Bsz — sgn B. 


Essentially the same conclusions were obtained as in the case of inde- 
pendent errors: 


1. When 6” < 2/2 , use b, , 

2. When > , use , 

3. bs; is advantageous for only a narrow range of values of the 
parameters and is therefore not likely to be of much interest. 


10. CONCLUSIONS 


In this paper we have considered the problem of estimating the 
slope of a linear functional relation when both variables are in error. 

When replicated observations are made a number of estimators are 
available, all of which have approximately the same asymptotic variance 
and mean square error, but study of the bias enables us to choose 
among them when we have partial information concerning the 
parameters. 

When there is no replication of observations and the errors are 
suitably restricted, there exists a class of consistent estimators which 
are ratios of linear forms in the observations. When partial information 
is available concerning the spacing of the X, there are rational grounds 
for choosing a suitable member of the class. 
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STATISTICS FOR A DIAGNOSTIC MODEL’ 


ADRIANUs J. VAN WOERKOM AND KEEVE BRODMAN 


Cornell University Medical Center 
New York, New York, U.S. A. 


INTRODUCTION 


In recent years, several methods have been proposed for making 
medical diagnoses by machine (Ledley and Lusted [1959], Crumb and 
Rupe [1959]). A method devised by Brodman et al. [1959, 1960] has 
been used to program a high-speed electronic computer for making 
presumptive medical diagnoses using only information relating to the 
age, sex, and responses of patients to a standardized health questionnaire. 

The method assigns patients to none, one, or several of 60 selected 
disease categories. The 60 diseases most frequently diagnosed by 
hospital physicians in men and the 60 diseases in women were chosen 
for study. The method was developed with data referring to 5,929 
consecutive adult white patients (2,718 men and 3,211 women) ad- 
mitted to the outpatient departments of The New York Hospital, a 
large general hospital, during the 18-month period beginning July 
1, 1948. It was tested with data referring to 2,745 consecutive adult 
white patients (1,280 men and 1,465 women) admitted during the 
12-month period beginning January 1, 1956. 

Each patient's symptoms were elicited through a printed form, the 
Cornell Medical Index-Health Questionnaire (CMI). The CMI was 
devised to collect diagnostically important elements of the medical 
history given by general medical patients, without expenditure of a 
physician’s time. Solely with these data, a physician can often correctly 
predict which diseases will be found in subsequent examination (Brod- 
man et al. [1951)). 

Additional data abstracted for analysis from the hospital records 
include each patient's sex and age, along with the diagnoses made by 
hospital physicians after eliciting a history and performing physical 
and laboratory examinations. These diagnoses for the 1948-1949 data 
were coded according to the U. S. Public Health Service Manual for 
Coding Causes of Illness [1944] and form the standard against which 
the method is evaluated. 


1Leo S. Goldstein and Albert J. Erdmann Jr. participated in this study, which was carried out at 
the Department of Medicine, New York Hospital-Cornell Medical Center with the support of a Public 
Health Service Research Grant. 
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The problem may be phrased in the following terms: Patients in 
the sample may belong to a number of specified disease categories. 
Patients were assigned by physicians to disease categories with a low 
incidence of false positives (incorrect diagnoses) but were not assigned 
to every category to which they belonged. Each patient has a number 
of attributes (complaints on the CMI). These attributes may or may 
not be correlated with each other. No one-to-one relation exists be- 
tween categories and attributes. The problem is to assign patients to 
categories solely by means of attributes indicated on the CMI, with a 
maximum of correct and a minimum of incorrect assignments. 

There are two obvious approaches to the solution of this problem: 


1. The use of the conditional probabilities of a patient's having 
an attribute, given the category to which he belongs. From these, 
using Bayes’ theorem, the conditional probability can be found for 
the patient’s belonging to a specific category, given the attributes 
(Feller [1957], Chapter 5). 

2. The use of significance values or weights for the attributes with 
respect to the categories. 


CONDITIONAL PROBABILITIES 


Let P, be the probability or relative frequency of attribute A, in 
the total sample, and p;, the conditional probability of the attribute 
A, given the category D; . Then 


pis = Pr (A, | D,). (1) 


If n; is the sub-sample size of category-D,; and N the size of the 
total sample, then 


Pr (D;) = n;/N. (2) 

The conditional probability for a group of attributes A,, , --- , Ax, is: 

Pr (Ay, Av, | D,) = Pr (Au, | D,) Pr (Au, | D,) Pr (Ai, | D))- @) 

Using Bayes’ theorem, the probability of the patient’s belonging to 
category D; given the attribute complex A,, , «++ , Ax, is: 

_ Pr (As, | Pr (Aa, | Dy) Pr(D))_ 

Pr (A,, | D,) Pr (Ax, | Di) Pr 


Pr (Dj | Ai, Ax.) (4) 


The expression (4) for Bayes’ rule will have to be adjusted for correla- 
tion between the attributes. As can be seen from Table 1, the sample 
sizes of the 60 selected diseases are generally quite small. These sample 
sizes are of the order of 30, which makes the measurements of the 
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TABLE 1 
SAMPLE Sizes or 60 DisEASES IN MEN AND WoMEN. 
Sample Men Women 
Size N N 
10-19 16 8 
20-29 13 12 
30-39 8 14 
40-49 6 6 
50-99 10 12 
100-149 6 5 
150-404 1 3 , 


correlation coefficients uncertain. In Table 2 a tabulation is given for 
the correlation coefficients for the symptoms with higher proportionality 
in the disease sub-samples than in the total sample. The coefficients 
are reduced to unit variance. Only 22 percent of these correlations are 
more than twice their standard error. : 

In general, a patient has more than two symptoms and multiple 
correlations will have to be considered. Because of the small sub- 
sample sizes, these multiple correlations, either directly observed or 


TABLE 2 
DISTRIBUTION OF ITEM INTER-CORRELATIONS REDUCED TO UNIT VARIANCE, 
Correlation/Variance N 

4.0-6.0 12 
3.0-4.0 20 
2.0-3.0 43 
1.5-2.0 43 
1.0-1.5 41 
0.5-1.0 57 
0.0-0.5 38 
0.0-(—0.5) 44 
(-—0.5)-(-—1.0) 24 
(—1.0)-(-—1.5) 13 
(—1.5)-(-2.0) 3 
(—2.0)-(-—3.0) 0 
(-—3.0)-( —4.0) 0 
(—4.0)-(—-6.0) 0 
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TABLE 3 


NuMBER OF DisEAsES DIAGNOSED PER PATIENT (MAXIMUM OF 3). 


Number of N 


Diseases Women 


1635 
811 
765 


derived from the covariances, will be more uncertain than the zero 
order correlations and their use could lead to a large amount of bias. 
In view of this uncertainty and the tremendous amount of work in- 
volved, the measurement of all the correlations needed for the proper 
application of Bayes’ rule is not justified. 

Of particular interest with respect to the use of Bayes’ rule, many 
patients have more than one disease. In Table 3 a distribution of 
diagnosed diseases is given for the 1948-1949 New York Hospital 
population. 

The presence in a patient of more than one disorder considerably 
complicates a method using conditional probabilities. Symptoms 
claimed by a patient with a particular diagnosed disease may be related 
to other and often undiagnosed diseases. Due to a random distribu- 
tion of most diseases with respect to each other, the co-existence of 
diseases in a patient will not seriously obscure the cluster of symptoms 
having substantially higher proportionality within a disease category 
than in the total sample, nor will the co-existence of diseases seriously 
distort the correlations of these symptoms within the disease category. 
Correlations between symptoms which have an incidence within the 
disease category similar to the incidence in the total sample, however, 
may be due to other diseases. 

Some of these difficulties could be avoided by studying disease 
complexes rather than single diseases. It is evident from the sample 
sizes of single diseases as shown in Table 1, however, that the study of 
disease complexes in the sample available would not have been possible 
because of the small sub-sample sizes for these complexes. Even in a 
sample much larger than the one available, compounding of error 
because of false negatives would still be uncontrolled. 

The effect on the conditional probabilities of the presence of diseases 
other than the one being studied would be partially eliminated by using 
only those attributes which have a substantially higher incidence within 
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% 
Men Women 

1 1456 54 51 

2 646 24 25 
P 3 616 22 24 
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TABLE 4 
HYPOTHETICAL SAMPLE FOR CONDITIONAL PROBABILITIES. 


90 


A 33% 60% 
Az 33% 60% 
n(A 1A 2) 9 4 
Pr(D|A1A2) 9/13 


the disease category than in the total sample. This approach would 
also eliminate those symptoms which occur less frequently in the 
disease than in the total sample. (In clinical practice, these symptoms 
are given little diagnostic weight.) 

Another objection to the use of Bayes’ rule is that the conditional 
probabilities for a disease, given a set of attributes, is directly propor- 
tional to the sub-sample size of the disease category. (The medical 
profession first considers diseases with a high incidence but does not 
make a diagnosis on this basis.) 

If the data available are consistent and complete, Bayes’ rule will 
give a mininum number of wrong assignments. If the data are incon- 
sistent and incomplete, as in the sample studied, there may be many 
cases of wrong assignments and methods other than Bayes’ might be 
more effective. Referring to Table 4, if the 9 cases in D, with attributes 
A, and A, were false negatives in the data with regard to D, , the 
hypothesis that all patients having A, and A, belong to D, will be 
more effective than the use of Bayes’ rule. This hypothesis can be 
tested only by re-examining hospital records or re-calling patients. 

Notwithstanding the objections raised, the conditional probability 
method, with the modifications described above, was tested with the 
1948-1949 sample of male patients. The results showed a number of 
expected inconsistencies. Nearly always, those categories with the 
largest number of attributes with high relative frequencies were favored. 
In addition, categories with small sample sizes and with a small num- 
ber of attributes of high relative frequency (that would have been 
identified by a physician in many cases) failed to get probabilities high 
enough to be considered. 

The most reliable information in the data is the diagnoses made by 
physicians after they have examined the patients. The one thing that 
can be established with minimum error from the data studied here is 
the significance of an attribute with respect to a disease. The con- 
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ditional probability approach fails to make use of this information. 
It was found from clinical experience and from noting the relative 
frequencies or proportionalities P, and p,, that a disease category is 
characterized by a cluster of attributes each with a much higher pro- 
portionality in the disease category than in the total sample. If a 
patient’s cluster of complaints is similar to the cluster of complaints of 
the average patient in that disease category, he can be assigned to the 
category. This approach is discussed in the following section. 


SIGNIFICANCE VALUES 
Let the variable S/, be given as 


Sie = (pix — — P,), (5) 


where the notations are as before. It can be shown that in a sample 
where the attribute A, is randomly distributed with probability P, , 
the variable S‘, is approximately normally distributed if n;P,(1 — P,) 
is not too small. However, according to Feller [1957 p. 170], the error 
committed in replacing the binomial distribution by the normal is 
surprisingly small, even for values of n,;P,(1 — P,) of the order of 1.5. 
The comparison between the two for the probabilities of the variable 
between two boundaries is by far not as good, but this is of little conse- 
quence in this case. Then in the sub-sample of size n, , the probability 
of observing the value S/, by chance is proportional to the expression 
exp (—S‘j). The observed value of S/, in the sub-sample of category 
D; therefore expresses a measure of significance in the usual sense. 
Because the constant 7; occurs in the significance values for all attributes 
with regard to the category D; , this factor can be dropped from the 
expression. Then, 


(pa — — Pi) ~ — 


The term (1 — P,) varies between .99 and .46 with nearly all values 
around .80 with the square root equal to .9. By ignoring the term 
(1 — P,) an error is made of approximately 10 percent. This error is of 
little consequence because of statistical inaccuracies in the other 
parameters. 

Let all attributes A, for which S/{ > 2 be called significant attributes. 
If the complex of significant attributes contains more than one attri- 
bute, >> Ss? represents a measure of the joint probability of the 
attribute complex and thus the significance of the complex. The signifi- 
cance value of the complex should also include the correlation between 
the attributes. As mentioned before, however, in the sample under 
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study these correlations are generally insignificant and a linear model 
ean be used. 

The variable S/{ measures not only the significance of the attributes 
but also their correlation with respect to the categories. The observed 
coincidence of category D; and attribute A, is equal to (n;/N)p,;, and 
the product of the expected values is (n;/N)P,. The co-variance is 
then equal to 


(n;/N)pix — = — Pr)- (7) 


In order to reduce (7) to the correlation coefficient, the expression 
has to be divided by the square root of the product of the variances of 
n,/N and P,. The factor n;/N is constant for all attributes in the same 
category and therefore can be eliminated. The variance of P, depends 
on the universe from which our sample is drawn. If the universe has a 
Poisson distribution the value is equal to P, ; if the universe is binomial 
the value is equal to P,(1 — P,). 

The resulting expressions 


(pin —P)/VP, or (pie — Pd)/ VPA — Py) 


are identical to S4{ (6). 
The following form was adopted for S;, : 


Si = — — 1, (8) 


where the factor 2 in the denominator yields a convenient scale. A 
minimum value of 3 was originally set for ~/P, . Further study of 
the data indicates that setting a minimum value for this is unnecessary, 
and that all negative values can be set to zero. 

If the attributes A,, , --- , A,, are present in a patient, the corre- 
sponding sums 


(%), = Sh (j = 1, +++ , 60) (9) 


are called the scores. The scores for a patient are normalized by divid- 
ing them by the mean score for the entire category. This normalization 
compares the patient to the average patient. If the sample sizes had 
been kept in the variables S;, they would have cancelled out at this 
point. 

It cannot be assumed that the score as indicated in formula (9) 
will give optimal results. The score is essentially a measure of the 
probability of the chance existence of any sub-sample with the same 
relative frequency p;, for the attributes A,, , --- , A,, as in the sub- 
sample of category D; . When the score is high this probability is low, 
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that is, a high score indicates a small probability for the patient’s not 
belonging to the category. Had the linear sum of the significance 
values S;, been used to determine the score, small changes in the 
significance values would be reflected by large changes in the probabili- 
ties. This would make the score a bad indicator of the probabilities. 
If powers of S,, higher than the second were used, the score would be 
a bad indicator for the opposite reason. 

Various models (linear sum, sum of squares, sum of higher powers, 
etc.) may be compared quantitatively only if the distribution of scores 
in both the restricted and the category sub-samples are known. By 
restricted sample is meant the total sample minus the category sub- 
sample. These distributions could not be obtained for the sample 
studied, because the restricted sample contains patients who really 
belong to the category sub-sample but have not been assigned to it in 
the hospital (false negatives). Some of the disease categories, further, 
are significantly correlated. These correlated category sub-samples 
must be removed from the restricted sample in order to get the desired 
distribution. Removal of false negatives and adjunct category sub- 
samples is impossible for a large sample. 

Physicians, when making a diagnosis, consider the patient’s age. 
Table 5 shows the age distribution by decades of the 15 diseases diag- 
nosed most frequently in men and in women in the 1948-1949 popula- 
tion. The relative frequency of a disease category is a function of age. 
The use of these relative frequencies in the sense of relative probabili- 
ties is not consistent with a model based on significance values of the 
attributes. There is, however, another aspect to be considered. Let 
the sample be subdivided into a number of age groups. The relative 
sub-sample sizes (r;),, for disease category D; and age group m will in 
general not be constant with respect to m. The significance value of an 
attribute with respect to a category is a function of the sub-sample 
size. If no subdivision of the total sample is considered, the effect of 
the sub-sample size is eliminated because the score of the patient is 
always compared to the score of the average patient and the sub-sample 
size does not have to enter into the significance value. If the same 
comparison is made in case a subdivision exists, the sub-sample size 
will have to be considered in the significance value. The expression 
for (S;.) will be 


(Sida = V (ri) m(Pix — Pr) — (10) 
— Pi) VP, 


The mean scores for each age group within the disease category 
were computed to test the possibility that the relative frequency pj. 
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of the attributes within the category sub-sample is a function of age. 
No significant interaction was found between the mean scores and age. 

In order to smooth the relative frequencies of the disease categories 
with respect to age, moving averages of three successive decades were 
used. After the >> S?, scores were formed, using formula (8) for 
S;, , the scores were multiplied by (r;), . 

This modification of the significance value changes the distribu- 
tions of the scores for both the categories and total sample so that 
more success can be expected from the model. Indications of this are 
made in Figure 1, where J is the distribution curve for the restricted 
sample and J/ is the distribution curve for the sub-sample category. 
The dotted lines show the distribution curves using the formula modi- 
fied for age. The trend will be primarily towards a smaller number of 
wrong assignments (false positives). 


NUMBER OF CASES 


SCORE 
FIGURE 1 
DISTRIBUTION OF SCORES FOR CATEGORY AND ToTAL SAMPLE. 
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Because the process of assignment by physicians at The New York 
Hospital for the sample of patients under study cannot have been 
entirely divorced from the attributes, bias in assignment may be ex- 
pected with respect to the attributes. Bias in p;, arises partly as a 
function of the clinical process used in making a decision. A physician 
in oral interview elicits a patient’s symptoms and then investigates 
with physical and laboratory examinations the diseases he presumes 
to be associated with the symptoms. Some of these symptoms will be 
similar to those indicated by the patient on the CMI. The presump- 
tive diagnoses suggested by the symptoms reported to the physician 
can thus be expected to be related to the diagnostic assignments made 
from the attributes on the CMI. Bias in p;, arising from the clinical 
process is inherent in the data and cannot easily be corrected. 

In Table 6 is given a sample of the relative frequencies for 27 se- 
lected items on the CMI with respect to 6 selected diseases for men in 
the 1948-1949 population. The numbers in the heading of the table 
correspond to the item numbers on the questionnaire. The relative 
frequencies are expressed in percent. In the 7th line of the table the 
corresponding relative frequencies are given for the entire 1948-1949 
sample of male patients. The last six lines of the table give the corre- 
sponding significance indices (S;,). As can be seen, the complaints for 
the 6 selected diseases have very little overlap and form a good basis 
for differentiation of the diseases. The disease categories and items in 
the table were selected to illustrate this characteristic. The table 
shows that differential classifications can be made on the basis of the 
significance indices. 

The sample in Table 7 was chosen from the male 1948-1949 popula- 
tion to present a case where overlap among diseases exists in the com- 
plaints. In the first column of the table the item content is given with 
the item number from the questionnaire. Column headings identify 
the diseases. The last column gives the number of diseases for which 
the particular item is significant and the last line in the table shows the 
number of these items significant for the disease. All significance 
indices smaller than 3 are omitted from the table. Even with the 
overlap present, the table still shows that differentiation among diseases 
can be made on the basis of the significance indices. Table 8 gives a 
comparable illustration for the women in the 1948-1949 population. 

Some points in Tables 7 and 8 are of interest: 


1. In Table 7, item 56 of disease 121 (N = 12) illustrates bias 
introduced because of small sample size in the disease. 
2. In Table 8, item 41 of disease 382 is related to age. 
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Scores FoR 6 PATIENTS. 


MMMF F F 


Age— 


66 35 26 22 32 32 


Number of Complaints— 


68 11 85 52 47 27 


Disease Score Disease Score 
1 68 00 00 00 00 00 31 25 00 00 00 00 37 
2 12 00 12 00 00 00 32 12 00 12 00 12 12 
3 00 00 00 00 00 00 33 75 00 00 00 00 00 
4 50 00 00 00 00 00 34 95 00 00 00 18 00 
5 87 00 00 00 00 00 35 00 00 00 00 00 00 
6 43 00 00 00 00 00 36 00 00 18 00 37 00 
7 00 00 00 00 00 00 37 75 00 00 00 31 00 
8 00 00 00 43 12 12 38 12 00 18 00 18 00 
9 18 00 00 00 00 00 39 00 00 50 18 12 12 
10 18 00 25 00 00 00 40 12 00 25 00 00 00 
ll 18 00 95 00 00 00 41 31 00 00 00 00 00 
12 00 00 50 37 25 12 42 18 00 12 00 00 00 
13 00 00 50 00 00 00 43 68 00 00 00 00 00 
14 00 00 00 00 00 00 44 50 00 00 00 00 00 
15 00 00 95 00 00 00 45 75 00 00 00 12 00 
16 00 00 62 00 00 00 46 43 00 12 81 62 00 
17 00 00 00 00 00 00 47 31 00 00 00 00 00 
18 00 00 00 56 68 43 48 00 00 00 00 00 00 
19 37 68 75 00 00 00 49 00 00 00 00 00 00 
20 87 00 00 00 00 00 50 12 00 00 00 00 00 
21 93 00 00 43 25 12 51 31 00 00 00 00 00 
22 75 62 62 00 00 00 52 56 00 00 00 00 00 
23 75 00 00 00 00 00 53 81 00 00 00 00 00 
24 25 00 00 00 62 00 54 25 00 37 00 00 00 
25 00 62 00 00 00 00 55 56 00 00 00 00 00 
26 00 00 00 00 56 25 56 00 00 00 00 00 00 
27 00 00 37 00 00 00 57 00 00 00 75 87 00 
28 12 00 43 00 50 00 58 00 00 31 00 00 00 
29 87 00 12 00 31 95 59 18 00 00 00 00 00 
30 37 00 50 00 00 00 60 00 00 00 18 31 00 


3. In Table 8, item 28 of disease 382 represents the co-existence of 


disease 370. 


In the study of Brodman et al. [1959], the }> (S;,)2 model was used 


to diagnose diseases in the 1956 sample of patients. A constant criti- 


cal score of 35 for all categories was adopted, after examination of the 


aa 
Sex 
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scores obtained for the 1948-1949 sample. The use of critical scores 
determined for cach disease independently may improve the model. 

Table 9 gives the scores for 6 randomly selected patients diagnosed 
in the hospital as having rheumatic heart disease. The heading of the 
table gives the sex and age of the patients and the number of “‘yes” 
responses to the questionnaire. The number of diseases indicated for 
the 6 cases in the table ranges from 21 for the first case to 3 for the 
second and for the last case. 

The model developed with the S;, values derived from the 1948-1949 
sample of patients was used to program a data processing machine 
(van Woerkom [1960]) and was tested with the 1956 sample of patients. 
The machine made correct assignments in 44 percent of cases where 
the 60 diseases were diagnosed in the hospital. In order to test for 
false positives, that is, diseases diagnosed by the machine when the 
disease was not present, a sample of 350 patients was selected for which 
the hospital records could give evidence for the presence or absence of a 
disease. In only 5 percent of cases did the model generate false posi- 
tives. Results with the 350 patients are essentially the same as those 
obtained by a physician experienced in the interpretation of the CMI, 
except that for the diagnosis of psychoneurosis the physician made 
correct assignments more often than did the machine (81 percent as 
compared to 42 percent). 


CONCLUSIONS 


An approach used in efforts such as the one presented in this paper 
is best guided by the characteristics of the data interpreted. It is 
primarily because of the many false negatives in the large amount of 
data analyzed that the present model was developed. When small 
amounts of accurately defined data are analyzed the method may 
require revision. This paper presents a justification of the approach 
reported here, on an analytic basis and on the basis of the results ob- 
tained showing few false positives among many correct assignments. 
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159 NOTE: Three-Quarter Replicates 
of 2‘ and 2° Designs 
Peter W. M. Joun 


California Research Corporation, Richmond, California and 
University of California, Berkeley, California. U. S. A. 


1. THE 24 DESIGN 


The usual half replicate of the 2* design is defined by 1 = +2,22%532, ; 
the main effects are clear of two-factor interactions, but the two-factor 
interactions themselves are confounded in pairs. The three-quarter 
replicates given in this section enable both the main effects and two- 
factor interactions to be estimated clear of two-factor interactions. 

The designs are obtained by omitting any one of the following 
quarter replicates, defined by 7, = +a, ,%3 = 42,22. 


I. 1, ac, bed, = = 
Il. a, ¢, Od; = Le, = 


IV. ab, be, acd, d; = = —2,22. 


We consider the case in which I is omitted. 

The three quarters may be combined into three half replicates; II, III, 
= 2,2; 11, IV, a, = 2,2, ; ll, IV,2, = 

We estimate A from the half replicate III, 1V, where x, = —2,22%, , 
so that A is confounded with ABD. In the other half replicates A is 
confounded with the two-factor interactions BC or CD. The other 
effects are obtained, each from a half replicate, in the same way and 
the analysis is presented in tabular form below. It may be shown 
that these are the least squares estimates, when higher-order inter- 
actions are assumed to be negligible. BD, and the mean, may be 
estimated from two half replicates; the least squares estimates are 
then the averages of these two estimates. 


2. THE 25 DESIGN 


The main effects and two-factor interactions in the 2° experiment 
can all be estimated from a half replicate. The variance of each esti- 
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Effect Sets Used Confounding 
A Ill, 2. = —z2 ABD 
B II, 1V; 24 = 223 ABCD 
C Ill, IV; 2, = BCD 
D II, I]; z3 = ABCD 
AB II, IV; 24 = 223 BCD 
AC Ill, 2. = —z2 ABCD 
AD II, III; 23 = x22 BCD 
BC II, IV; 2% = x23 ABD 
BD II, 1V; 24 = x23 ABC 

or II, III; 73 = ACD 
CD II, III; 23 = ABD 


mate is o°/4, and all the degrees of freedom are used for effects. We 
present in this section a three-quarter replicate in which all the effects 
are estimable with variance 30°/16 and which provides 8 degrees of 
freedom for error. 

The three-quarter replicate using three quarters defined by 
= , = is discussed in Davies [1956]. In this 
design all the main effects and two-factor interactions, except E, AD, 
BC, are estimated by averaging the estimates from two half replicates 
with variance 307/16. The latter three effects, however, are estimated 
from only a single half replicate with variance o”/4. 

If the quarter omitted is defined by 7, = +2, , 2%; = 4%2%3 , we 
have a design in which each main effect and each two-factor interaction 
is estimated from two half replicates. The particular design obtained 
by omitting the quarter 7, = —z, , 7; = +2,2; has the additional 
advantage that it may be developed by augmenting a ‘‘one-at-a-time” 
experiment, Daniel [1958]. 


3. SOME ADDITIONAL DESIGNS 


The above designs possess a certain symmetry inasmuch as each 
factor appears at its high level and at its low level the same number 
of times. Another set of designs may be obtained when a half repli- 
cate, in which the highest-order interaction is confounded with the 
mean, is augmented by a quarter which also confounds a main effect. 
For example, one might take three of the sets of treatment combinations 
defined by 


j = +7, = +2732,(25) = 421 


In this design the first factor appears at one level in 2"~' points 
and at the other level in 2"~’ points. 
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It may nevertheless be shown that the method of analysis given 
in the previous sections still gives the least squares estimates. Such 
a design has the advantage in the 2* case over the design given in 
Section 1 that the effect which is estimated with greatest precision is a 
main effect rather than a two-factor interaction. 


REFERENCES 


{1] Daniel, C., [1958]. On varying one factor at a time. Biometrics 14, 430-1. 


{2] Davies, O. L., [1956]. The Design and Analysis of Industrial Experiments. Oliver 
and Boyd, London, 472-5. 


160 NOTE: On the Extension of Stevens’ Tables 
for Asymptotic Regression 


S. Lipton 


University of New South Wales 
Kensington, Sydney, Australia. 


Concerning H. Linhart’s note ({1960]. Biometrics 16, 125), I think 
it is worthwhile pointing out my own extension to Stevens’ tables. This 
work has been reported by H. D. Patterson ((1956]. Biometrics 12, 
389 and [1958]. Biometrika 45, 323) and was carried out at Rothamsted 
Experimental Station. The extended tables give, in Stevens’ notation, 
the six F’s for r = .10(.01).90 for each integral value of n from 3 to 12 
inclusive. These values do not in the main overlap Linhart’s work. 

The tables proved surprisingly “popular” and I received several 
requests for copies. However, as the entries corresponding to large r 
for small n seem to be somewhat inaccurate, (apparently they are 
correct only to about 4 significant figures compared to more than 6 
figures elsewhere) I am now recomputing the values. I intend to take 
the opportunity of further extending the range of n up to 15. 


161 NOTE: Corrected Error Rates for Duncan’s 
New Multiple Range Test 


H. Leon HARTER 


Aeronautical Research Laboratory 
Wright-Patterson Air Force Base, Ohio, U. S. A. 


The error rates published by the author [3] for Duncan’s new 
multiple range test were based upon critical values tabulated by Beyer 
[1] and by Duncan [2], some of which were in error, as reported earlier 
by the author [4]. On the basis of the corrected critical values for this 
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CORRECTED TABLE 1C 
MINIMUM VALUES OF az CORRESPONDING TO ag = 0.05, 0.01 


(az )min | ag = 0.05 


=16| N = 25| Noo 


2 | .0500 -0500 -0500 .0500 .0500 .0500 
3 | .0496 0411 .0402 .0396 
4 -0463 .0395 .0372 .0354 0342 -0338 0334 -0329 
5 | .0429 .0357 .0334 .0315 .0298 0295 


6 .0400 0329 .0287 .0275 .0266 
7 .0305 .0283 .0265 .0254 .0248 
8 | .0354 -0247 .0236 .0231 .0228 
9 | .0335 .0270 0250 0233 .0216 0214 -0209 
0 | .0320 .0256 0237 0221 .0210 .0203 -0199 


12 0294 0216 .0202 .0192 .0188 0181 
14 0274 0219 .0202 .0188 .0179 -0175 .0172 -0168 
16 .0257 .0189 .0176 .0168 .0164 -0162 -0158 
18 .0196 -0180 .0167 -0160 .0155 -0149 
20 | .0233 .0186 .0160 .0153 -0148 -0146 .0142 


(ar, min | ag = 0.01 


m|N=2|N=3|N=4|N=6|N =10|N =16| N =25| Noo 


2 0100 0100 0100 0100 0100 0100 0100 0100 
3 0098 0085 0081 77 0075 0074 0074 .0073 
4 0089 0072 0067 0063 0061 0060 0059 0058 
5 0079 0063 0058 0054 .0052 0050 0050 0049 


| 
6 -0071 .0056 -0051 .0048 .0045 .0044 .0044 .0043 
7 .0065 -0050 .0046 .0043 .0041 .0039 .0039 .0038 
: 8 .0059 .0045 .0041 .0039 .0037 .0036 .0035 .0035 
9 .0054 .0042 .0038 -0036 .0034 .0033 .0033 .0032 
5 10 .0050 .0039 .0035 .0033 .0031 .0030 .0030 .0029 
a | 12 | .0044 | .0034 | .0031 | .0029 | .0028 .0027 .0027 | .0026 
14 .0039 .0031 .0028 .0026 .0025 .0024 .0024 .0023 
“ 16 .0036 -0028 .0025 .0024 .0023 .0022 .0022 .0021 
18 .0033 .0026 .0024 .0022 .0021 .0020 .0020 .0020 
3 20 .0030 .0024 .0022 .0020 .0019 -0019 .0019 .0018 
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CORRECTIONS TO TABLE 2 
ComPaARISON oF TyPE II-III Error Rates ror SINGLE CLASSIFICATION 


A. Values of 83 = (8§)max for a = 0.05 | B. Values of 62 = (8§)max for a = 0.01 


N m | #&=1.5 =2.0 =2.5 &=3.0| N m | =2.0 =2.5 =3.0 =3.5 


3 464 .198  .0602 5 3 508 .229 .0726 .0183 
4 467 .0577* .0129 4 487 
5 472 =.0572 .0120 5 A479 «.0588 = 
6 478 6 476 «.0568 =.0114 
2 -508 -0626 12 .208 .0567  .0101 
0 532 -0685 .0123 16 498 .215 .0589  .0103 


&=1.5 =2.0 =2.5] 7 3 577 «.0556 .0088 


9 4 .169 .0251 9 3 .0126 
8 O77 5 411 .108 0119 .00075 
=0.5 8’ =1.0 =1.5 8’ =2.0 =1.0 8’ =1.5 8’ =2.5 
13 3 -0496 ll 8 .302 .0470 
4 .0537 12 62 .0528 
5 0572 16 246 .0577 .0033 
6 .384 
8 403 .0659 13 8 .667  ~=.201 .0185 .00051 
16 4 775 =©.257 .0214 .00046 &’=0.5 =1.0 8’=1.5 6’=2.0 
2 .0774 16 .0897 .0035 
4 -0858 6 .932 .536 .0946 
5 .0927 12 -947 .585 -116 
6 .0986 
21 16 .929 .440 .0388 
31 4 .573 .0385 
5 .0422 41 3 .678  .0372 
5 -0466 
8 -750 =.0565 
*For this case 63 = (8x)min = .0818 12 .0668 
16 .0743 


ic 
[ 
5 
61 10 -588  .0057 
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test recently published by the author [5], Table 1C of [3], which gives 
minimum values of the Type I error rate a, for the LSD test corre- 
sponding to as = 0.05, 0.01 for Duncan’s test, has been completely 
recomputed, and the corrected table is given below. Also given is a 
list of corrections to Table 2 of [3], which gives values of 83 = (8) max , 
the maximum combined Type II-III error rate for Duncan’s test, for 
a = 0.05, 0.01. To reduce the length of the list, corrections of a single 
unit in the last place have been omitted, except when there are larger 
corrections for other value (s) of 6’ for the same values of N and m. 
[In both tables, N represents the size of each sample, and m represents 
the number of sample means being compared. In Table 2, 6’ represents 
the ratio of the difference between the largest and smallest sample 
means in the group being tested to the pooled estimate s of the popula- 
tion standard deviation o]. Table 3 of [3], which gives maximum re- 
quired sample sizes (Ns)maz for Duncan’s test for prescribed values of 
a, 8, and m, has not been recomputed on the basis of the corrected 
critical values. If this were done, there might be an occasional change 
of 1, but most values are correct as they stand. 
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[1] Beyer, William H. [1953]. Certain percentage points of the distribution of the 
studentized range of large samples. Virginia Polytechnic Institute Technical 
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[2] Duncan, David B. [1955]. Multiple range and multiple F tests. Biometrics 11, 
1-42. 

(3] Harter, H. Leon [1957]. Error rates and sample sizes for range tests in multiple 
comparisons. Biometrics. 13, 511-36. 
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162 QUERY: Multiple Comparisons between 
Treatments and a Control 


For multiple comparisons between p treatments and one control 
Dunnett [1955] has tabulated values of t from which confidence limits 
can be calculated. His tables provide for values of p from 1 to 9, and 
for degrees of freedom from 5 to infinity. The full tables allow for 
different numbers of tests (n) for each treatment, but when the number 
is the same for each treatment the number of degrees of freedom is 
given by (p + 1)(n — 1), so that a simpler table can be derived for p 
against n, including the following:— 


a 
4 
| 3 
C 
A 
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P = 0.05 P =0.01 
n |p=2 4 7 9 |y#2 4 7 9 
2 2.85 2.81 2.81 4.43 3.96 3.83 
3 | 2.34 2.47 2.56 2.60 | 3.61 3.45 3.39 3.38 
4 | 2.18 2.36 2.48 2.54 | 3.19 3.20 3.22 3.24 


Does it really make sense for an increase in the number of treatments 
in each test to lead to smaller significant differences when there are 
only two tests of each, but larger when there are four or more? Or, 
when there are three tests of each, for an increase in treatments to 
increase the size of differences which are significant at P = 0.05 but 
reduce those at P = 0.01? 


REFERENCE 


Dunnett, C. W., [1955]. A multiple comparison procedure for comparing several 
treatments with a control. J. Amer. Stat. Assoc. 50, 1096. 


ANSWER: 


At first sight the behaviour of the table does appear rather odd. 
Intuitively one would probably expect an increase in the number of 
treatments to lead to a larger significant difference in all circumstances. 
This would certainly be the case if the only error variation were that 
associated with the control and treatment means. But it must be 
remembered that the variance has to be estimated, and the value of ¢ 
has to allow for error in its value too. The reason the value of ¢ de- 
creases with p for the small values of n is that there the number of 
degrees of freedom for estimating the variance is small and, in effect, 
we gain more from the increase in degrees of freedom than we lose as a 
result of the greater number of treatment means. 

If the table were extended to larger values of p, the value of ¢ for 
n = 2, and for n = 3 when P = .01, would pass through a minimum 
and then increase with the value of p, indicating that a point is reached 
at which any further increase in the number of degrees of freedom is 
not sufficient to compensate for the increase in the number of treat- 
ments. For values of n > 4(P = .01) and n > 3(P = .05), this is the 
situation which pertains for all values of p. 
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It may be verified that the same phenomenon occurs in the case of 
the Studentized range, if the percentage points of that distribution 
are tabulated with n as parameter instead of the number of degrees 
of freedom. 


C. W. DuNNETT 

Lederle Laboratories Division 
American Cyanamid Company 
Pearl River, New York 


163 QUERY: Error Rates in Multiple Comparisons 


Many biologists, realising the necessity for statistical examination 
of data, are unfortunately without access to professional advice, and 
must perforce search the literature themselves. One such worker 
encountered Steel’s description [1959] of a multiple comparison sign 
test, which seemed to fill an urgent need, yet on closer study to reveal 
an apparent paradox. As his example Steel applies his test to data 
from 13 soybean yield trials of 3 varieties, and concludes that one 
variety (Z) was significantly better than control (C) because it was 
inferior (—) to control in only 2 of the trials. If, however, there had 
been five varieties in each trial, Z would not have been significantly 
different from control, because with 5 treatments the number of minus 
signs must not exceed one for significance. And yet the inclusion of 
two more varieties in the trials could not have made one iota of differ- 
ence to the yield figures for Z and C from which alone the number of 
inferiorities was obtained. How can the presence or absence of data 
about W, Y, etc., entirely irrelevant to the Z :C comparison and to all 
the computations involved alter the probability that Z is the same as C? 
Or are there implied assumptions, not apparent to the amateur reading 
Steel’s paper, about the behaviour of W and Y relative to Z and C 
which determine when this test should be used in preference to Dixon 
and Mood’s [1946] simple sign test? 


REFERENCES 


Dixon, W. J., and Mood, A. M., [1946]. The statistical sign test. J. Amer. Stat. 
Assoc. 41, 557. 

Steel, R. G. D., [1959]. A multiple comparison sign test: treatment versus control. 
J. Amer. Stat Assoc. 54, 767. 
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ANSWER: 


This query seems to arise from a failure to recognize that several 
definitions of error rate exist. These, of which only two are considered 
here, were introduced in connection with multiple comparison pro- 
cedures and are just now finding their way into application and text- 
book. The decision as to which error rate is more appropriate and 
what significance level is to be used must, finally, be made by the 
experimenter. 

Error rates are defined on the basis that the null hypothesis is true. 

Per-comparison error rate = 

Number of comparisons falsely declared significant 


Total number of comparisons 
Here, the comparison is the conceptual unit. When comparisons 
are chosen without reference to the experimental results, a test such 
as the (parametric) /sd provides a per-comparison error rate at the 
tabulated value regardless of whether or not the comparisons are inde- 
pendent. A criticism of tests using this error rate is that, if many 
comparisons are made, the probability of finding at least one falsely 
significant difference is high. 
Experimentwise error rate = 
Number of experiments with at least one difference 
falsely declared significant 


Total number of experiments 


Here, the experiment is the conceptual unit. For pairwise compari- 
sons, we agree to test the largest difference when it occurs. If this 
difference is significant, then this experiment is one for which at least 
one difference has been declared significant. Tukey’s (parametric) 
test based on the studentized range has such an error rate; Dunnett's 
(parametric) test of treatments against control also has this error rate. 

Clearly, tests with an experimentwise error rate will require a 
larger difference for significance than that required by the lsd. Further- 
more, the required difference will increase with the number of treat- 
ments. This becomes a basis of criticism: the probability of detecting 
a real difference of fixed size is lower when an experimentwise error 
rate is used and decreases with the number of treatments. 

Error rates are not, perhaps, as different as they first seem. If 
a@¢ and ag represent per-comparison and experimentwise error rates 
respectiveiy, then for k independent comparisons (1 — ag) = (1 — ac)*. 
For dependent comparisons, the relation is not as obvious. Harter 
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[1957] has tabulated comparisons of significance levels for a number of 
multiple comparisons test procedures intended to compare all pairs 
of means. 

It is apparent, then, that if an investigator chooses a definition of 
error rate, a test, and a significance level, then this information permits 
him to compute the significance level for any other suitable test and 
error rate. This knowledge eliminates any paradox. 

No statistical assumptions determine which test is appropriate, 
regardless of whether the test is parametric or non-parametric. One 
chooses an error rate and significance level, prior to the conduct of the 
experiment, to give the kind of protection desired. It seems to me 
that the basic problem concerns a power function, presumably related 
to ‘‘urgent need’’ and, in turn, the sample size necessary to accomplish 
clearly stated aims. 


REFERENCE 


Harter, H. Leon, [1957]. Error rates and sample sizes for range tests in multiple 
comparisons. Biometrics 13, 511-36. 


R. G. D. STEEL 

Institute of Statistics 

North Carolina State College 
Raleigh, N. C., U. 8. A. 


| 
af 


BOOK REVIEWS 


J. G. SKELLAM, Editor 
Members are Invited to Suggest Books for Listing or Review to the Editor 


FALCONER, D. 8. Introduction to Quantitative Genetics. Jdinburgh and 


e London: Oliver & Boyd Ltd., 1960. Pp. ix + 365. Figures and Tables. 35s. 


W. F. Bopmer, Department of Genetics, University of Cambridge, Cambridge, England. 


There has long been a need for a good introductory textbook on quantitative 
genetics, and Dr. Falconer’s new book satisfies this need more than adequately. 
The term quantitative genetics is here used in its broadest sense to include both the 
study of genetic changes in populations and the study of the inheritance of continuous 
variation. The genetic analysis of changes in quantitative characters in both natural 
and artificial populations requires a close interplay between these two aspects. 

The first five chapters of the book are concerned with the analysis of changes 
in gene frequency in natural and artificial populations. These provide perhaps 
the best elementary exposition I know of what is usually called population genetics. 
Dr. Falconer has a great gift for lucid and stimulating exposition. He presents 
the essential mathematics in a way that should be intelligible event to the least 
mathematically minded biologist. The numerical examples are excellently chosen 
to help in the understanding of the mathematical formulae as are also the graphical 
illustrations. In my opinion Dr. Falconer rightly assumes a knowledge of elementary 
genetics and later also of the elements of statistics. His book would have been 
unnecessarily burdened by any attempt to make it complete in these respects. 

The genetics of continuous variation is treated in the following fifteen chapters 
with the same high standard of exposition. This subject has been approached in a 
variety of ways by different research schools and suffers from a confusion of termi- 
nology and notation. Dr. Falconer sets himself the difficult task of integrating the 
subject at an elementary level and is on the whole most successful. It is not surprising 
if the subject matter is somewhat biased toward the approach of the Edinburgh 
‘school’, of which he is a member. Dr. Falconer is at least honest in delineating 
controversial topics and making it quite clear when a discussion is more a matter 
of personal opinion and preference than of established fact. 

Any criticism of the subject matter is perhaps more a criticism of the develop- 
ment of the subject than of Dr. Falconer’s account of it. However there is a notable 
lack of any emphasis on the importance of linkage, and the treatment of Mather’s 
concept of balance is rather brief. The importance of epistacy is also, in my opinion, 
underestimated. A good epistatic genotype may be quite rare, and so contribute 
only little to an interaction variance, and yet be of considerable importance to the 
practical breeder. As Dr. Falconer says in his final discussion, there is need for much 
more experimental work. This should not, I feel, be directed at estimating more 
and more hcritabilities and variance components for a wide selection of characters 
and organisms, as he suggests, but aimed at a more penetrating and specific analysis 
of the fundamental mechanisms underlying the inheritance of quantitative characters. 
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In conclusion, this is a book that should appeal to a wide audience. For the 
experienced geneticist it provides a stimulating and refreshing review of the subject, 
and for the newcomer to genetics it offers an excellent introduction. There is no 
doubt that it will be the best standard textbook of its kind for some years to come. 


GOLDBERG, 8. Probability: An Introduction. Englewood Cliffs, N. J.: 


" Prentice Hall, Inc. 1960. Pp. xiv + 322. 30 Figures, 44 Tables. $5.95. 


PF. N. Daviv, Department of Statistics, University College, London, England. 


This book, written by a pupil of W. Feller, has been tried out, we are informed, 
on the freshman mathematics class of Oberlin College. This should give some idea 
of the level of mathematical sophistication which is aimed at and which the author 
generally achieves. 

The first chapter on the manipulations and the algebra of sets is necessary for 
the main development of the book. It will be found difficult for persons wishing 
to learn probability with a view to practical applications, but the would-be mathe- 
matician will find it interesting, for the elements of mathematical logic are introduced. 
Probability in finite sample spaces follows. The author does not really attempt 
to justify the calculation of a probability, being concerned simply to define a one 
to one correspondence between the field of events and the probability set, and then 
to discuss the sub-sets involved. He says: ‘‘The theory of probability begins when 
a sample space, S, the mathematical counterpart of an experiment, is specified’”’— 
an entirely proper point of view for a mathematican to take. The second chapter, 
which covers conditional and compound probabilities, Bayes’ formula and independ- 
ence, will be found rather stiff reading to the uninitiated. 

After a short discursus into elementary enumeration through the binomial and 
multinomial coefficients, with the arithmetic triangle and several combinatorial 
theories expounded, the remainder of the book is concerned with the properties 
of random variables. These are few brief notes towards the end on testing a statisti- 
cal hypothesis and on decision-making. 

For those persons who already know some probability theory this book will be 
enjoyable reading, if only to appreciate how familiar theorems can be wrapped up 
in mathematical language. For mathematicians in embryo who want to learn how 
a mathematician looks at the elements of probability theory this book will serve a 
useful educational purpose. For the statistician in embryo this book is not suitable 
since enlightenment can’ be achieved more simply elsewhere. (The reviewer has 
in mind, for example, An Introduction to Probability Theory and its Applications 
by W. Feller). But possibly the author did not intend to cater for this last class 
anyway. 
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ABSTRACTS 


The following are abstracts of papers presented at meetings of the British Region 
held on October 27 and December 13, 1960. 


745 W. T. WILLIAMS (Botany Department, University of Southampton). 
Some Applications of Electronic Computers in Plant Ecology and Taxonomy. 


In ecological survey the population under study consists of sample areas 
(quadrats) defined by the presence or absence of a number of plant species, whose 
names and ecological requirements may not be known. The problem is to find the 
major discontinuities in the population. This can, in theory, be solved by succes- 
sively subdividing the population so as to reduce the associations between the species 
by the greatest possible extent at each stage; this in turn involves setting up the 
correlation matrix at each stage and finding the species with the highest loading 
on the first principal axis of this matrix. To hold the entire matrix in a computer 
reduces unacceptably the space available for data. Instead of r, therefore, |r| is 
calculated, and the |r| values for each species summed as they are obtained. The 
species with the highest sum of |r| is necessarily that with the highest loading ‘on 
the first centroid axis of the matrix (|r|); this has been found to be an acceptable 
approximation to the answer required. Examples will be given of the application 
of this method to actual areas. 

Valuable information on the structure of plant communities can be obtained 
by carrying out the orresponding inverse (Q-technique) subdivision; and, by 
collating the direct ai.d inverse analyses, a completely objective account of the 
vegetation of a complex area can be given in extremely economical terms. 

In taxonomy it is sometimes desirable to carry out a conventional factor anlysis, 
with communalities and rotation. No programmes of this type seem to be available 
in Britain; but the standard programmes for the extraction of latent roots and 
vectors greatly reduce computational labour. Moreover, the existence of general 


“matrix schemes” makes calculation of specification equations a relatively simple 
task. 


746 J. N. R. JEFFERS (Forestry Commission, Wrecclesham, Farnham, Surrey). 
Data Processing in Biological Research. 


The first task in the application of electronic digital computers to the statistical 
analysis of data arising in biological research has been the writing of the programmes 
for the actual analysis. This is, however, only a small part of the whole process, 
and the paper presents the results of recent work on the recording, compilation, 
and storage of data on paper tape and magnetic tape. This work suggests the need 
for a complete revision of the methods used in handling biological data, and has 
shown very large savings in the cost of research and in the unproductive use of key 
research workers. Also considered is the problem of the output results from the 
computer in a directly intelligible form, though progress has been slower in this field. 
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747 F. YATES (Rothamsted Experimental Station, Harpenden, Herts.). Problems 
Arising in the Use of Electronic Computers in Statistical Analysis. 


A small electronic computer has been in use in the Rothamsted Statistics 
Department for the last six years. It has been used for a wide variety of statistical 
problems arising in agricultural and biological research. It was early applied to the 
analysis of replicated experiments and a large number of such analyses are now 
performed every year. More recently its use in the analysis of surveys has been 
developed. A general programme which has been written for survey analysis will 
be outlined and used to illustrate the types of problem that are encountered in using 
electronic computers for statistical work. 


C. W. EMMENS (University of Sydney, N. S. W., Australia and Royal 
748 Veterinary College, London). The Planning and Analysis of Some Field 
Trials with Cattle. 


Three field trials of the fertility of deep frozen semen have recently been 
conducted in Sydney. They were as far as possible completely balanced, on a 
factorial scheme, and have given remarkably consistent results, with residual 
x?-values within expected limits. This is attributed to the care with which randomisa- 
tion and technique were controlled under difficult conditions. 


C. C. SPICER (Imperial Cancer Res. Fund, Lincoln’s Inn Fields, London). 


749 problems in the Analysis of a Large Scale Clinical Trial. 


The purpose of this trial was the evaluation of chemotherapy in the treatment 
and prevention of chronic bronchitis. It presents a number of points of interest 
both in planning and analysis. 


The following are abstracts of papers presented at a special meeting on ‘“‘BIO- 
METRICAL ASPECTS OF PLANT GROWTH” held in London on January 2, 
1961, by the British Region in conjunction with the Society for Experimental Biology. 


J. A. NELDER (National Vegetable Research Station, Wellesbourne, War- 


ta wick). Models and Experiments for Growth Analysis. 


The relationship of growth analysis to other forms of statistical analysis, partic- 
ularly those of long-term experiments and multivariate analysis, is indicated. The 
necessity for the development of methods for analysing the inter-related growths 
of different parts of a plant is stressed, and a first effort model of differential equa- 
tions analagous to linear regression is proposed. Types of deviation from the assumed 
model, both systematic and random, and the kind of experiment needed to detect 
them are discussed together with problems arising in the estimation of parameters 
in growth equations. Possible applications of the model are indicated. 
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S. C. PEARCE and C. 8S. MOORE (East Malling Research Station, Nr. 
751 Maidstone, Kent). A Study of the Sources of Variation in Growth of Fruit 
Trees. 


A method of studying growth previously described (Biometrics 16, 1-6) is applied 
to annual records of apple tree trunk circumference. The purpose of the investiga- 
tion is to determine the main causes of variation in field trials with clonal fruit trees. 
Three standard errors are plotted against the logarithmic development of girth, 
namely, (a) log (girth), (b) increment in log (girth) since planting, and (c) log (girth) 
adjusted by girth at planting. A study of these curves enables the total variation 
resulting after a period of growth to be divided between initial variation, and initial 
growth rate negatively correlated with initial size differences, and a subsequent 
growth rate which is uncorrelated with initial size. Comparison of groups of trees 
having different treatments demonstrates the importance of good growing condi- 
tions in minimising variation. The reduction in positional variation by removing 
block effects and the results of cropping are also considered. The effects of these 
modifications in conditions accord with the theoretical model. Some measures are 
suggested for minimising error in field trials. 


M. J. R. Healy (Rothamsted Experimental Station, Harpenden, Herts.). 


ve Experiments for Comparing Growth Curves. 


Consider an experiment designed to study the differential effects of treatments 
on the growth curve of some organism. Suppose that the experimental subjects 
are allocated to the treatments by some process of randomisation and that observa- 
tions are taken when the treatments are first applied and at regular intervals there- 
after. Wishart suggested that tests of significance for the existence of treatment 
effects could be made by fitting a polynomial to the data from each subject and by 
applying standard statistical techniques to the coefficients of the polynomials. The 
paper discusses Wishart’s technique and extends it to provide estimates of the 
treatment effects. 

A general discussion was led by F. L. Milthorpe (University of Nottingham.) 


CORRECTION 


E. N. Hey and M. H. Hey [1960]. The Statistical Estimation of a Rectangular 
Hyperbola. Biometrics 16, 606-17. 


The expression, nine lines from the bottom of page 609, should coincide with 
the column vector on the right of the matrix equation at the top of page 610. The 
solution for a, b, and c — ab on page 610 should have coefficients bracketed to agree 
with the matrix equation at the top of the page. In footnote 2, page 615, Ey in 
the matrix should be EZ, and on page 617, line 6, x should be replaced by z. 
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THE BIOMETRIC SOCIETY 


International 
ANNUAL FINANCIAL STATEMENTS 
Tue Biometric Society 1960 
BALANCE SHEET 
Assets 
Cash: Bank Balance $9,605.90 
Petty Cash 19.40 $9 625.30 
Liabilities 
Subscriptions, 1961 $ 107.50 
Dues, 1961 54.50 $ 162.00 
Surplus, Jan. 1, 1960 (including petty cash) 7,048.64 
Gain for Period 2,414.66 9 ,463 .30 
$9 625.30 
Audited: B. G. Selvidge (Signed) 
Date: March 20, 1961 
INCOME AND EXPENDITURE STATEMENT 
Income 
Subscriptions, 1959 $ 358.75 
Subscriptions, 1960 6,225.00 $ 6,583.75 
Dues, 1959 105,50 
Dues, 1960 2,466.00 2,571.50 
Sustaining memberships, 160 650 .00 
Back dues and subscriptions 32.00 


Regional allotments 


116.50 

BIOMETRICS allotment from sustaining members 250.00 

Back issues 93 .50 

Member subscriptions to Journal of ASA 35.00 

Sale of directories 2.00 

Overpayments 20.50 

Printing—Harvard University Press 30.00 

4 Advance to Pharmacology Symposium 1,000.00 
Bank refund of service charge 1.00 

1,548.50 
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Less: Credits and regional allotments used 138.00 1,410.50 
Total Income $11,247.75 
Expenditures 

BIOMETRICS $6 ,996 .28 

Postage 250.23 

Office supplies 2.89 

Printing 260.29 

President’s Office 200 .00 

Member subscriptions to Journal of ASA 35.00 

Addressing and mailing services 88.40 

Pharmacology Symposium 1,000.00 $ 8,833.09 
Excess of Income over Expenditures 2,414.66 


$11,247.75 


Audited: B. G. Selvidge (Signed) 
Date: March 20, 1961 


SECRETARY’S ACCOUNT 
STATEMENT OF INCOME AND EXPENDITURE 
For the Period Ist January, 1959 to 31st December, 1960 


Income 

Balance in hand, 3lst December, 1958 £ 64.10. 4d 
Received from Treasurer 266.11. 3d 
Menbership dues received ' 41.12. -d 
£332.13. 7d 

Expenditures 
Office equipment and stationary £ 56. 2. 6d 
Secretarial assistance 150. -. -d 
Printing and binding 13.10. 7d 
Postage 49.12. ld 
Travel 29.15. 9d 
Books 18. 8. -d 
Membership dues paid over 1.13. 6d 
£319. 2. 5d 
Balance, 31st December, 1960 £ 13.11. 2d 


I certify the above to be a true record of my transactions on behalf of the 
Biometric Society 


Secretary 


I have examined the account book and vouchers produced by the Secretary 
and certify that the above statement is in accordance therewith. 


E. Church, A.A.C.C.A. 
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BIOMETRICS, VOLUME 16 
STATEMENT OF OPERATIONS 
For the Year Ending January 31, 1961 


Income 
Biometric Society: 
907 Subscriptions at 
983 Subscriptions at 


9 Sustaining Members at 


1161 Direct Subscriptions at 
Sale of Back Issues: 

Biometric Society 

Editor’s Office 


March 1960 Issues at Cost to 
Biometric Society 

Sale of Reprints 

Over Payments 

Payments to Regions 


Total Income from Operations 


Expenditures 
Cost of Printing Journals 
Issue No. 1 
Issue No. 2 
Issue No. 3 
Issue No. 4 


Mailing and Express Charges 
Issue No. 1 
Issue No. 2 
Issue No. 3 
Issue No. 4 


Cost of Printing Reprints (See Comments) 


Issue No. 4 (1959) 
Issue No. 1 
Issue No. 2 
Issue No. 3 


Mailing Charges Reprints (See Comments) 


Issue No. 4 (1959) 
Issue No. 1 
Issue No. 2 
Issue No. 3 


$ 4.00 $ 3,628.00 
2.75 2,703.25 
25.00 225.00 $ 6,556.25 


7.00 8,127.00 


$ 374.00 
4,474.00 4,848.00 


61.28 
1,537.75 
11.50 
6.50 


$21,148.28 


$2,928.85 

3,344.71 

2,988.44 

4,467.72 $13,729.72 


$ 206.28 
229 .82 
310.70 
346 .56 1,093.36 $14,823.08 


$ 290.69 
329.43 
331.79 
370.75 $ 1,322.66 


$ 24.01 
27.99 
22.75 
38.94 113.69 $ 1,436.35 
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THE BIOMETRIC SOCIETY 


Operating Expenses 
Stamps $ 297.28 
Office Supplies 523 .68 
Mailing Lists and Addressographing 131.75 
Back Issue Moving Costs 182.94 
Back Issue Handling and Storage 329.76 
Back Issue Insurance 46.35 
Auditing 45.00 
Bank Exchange and Service Charges 2.43 
Refunds and Overpayments on Subscriptions 55.25 
Salaries and F.I.C.A. Taxes 525.02 
Transfers to Regions 6.50 
Express Charges 13.97 


$ 2,159.93 


Total Expenditures from Operations 


Surplus from Operations 


Non-Operating Items 
Income 
Bank Interest $ 680.75 
Refund on Insurance Policy 31.66 
Bank Credit and Exchange 2.06 
Announcement 57.00 


Refund on Blacksburg Postage Deposit 66.61 
Correction of Surplus from Previous 
Volumes (See Comments) 


Expenditures 
Credits of 1959 Accounts Receivable 


Surplus from Non-Operating Items 


Gross Surplus, 1-31-61 


BIOMETRICS, VOLUME 16 
BALANCE SHEET 
January 31, 1961 
Assets 
Accounts Receivable 
Bank Balances 
Savings Account #1 (Blacksburg) 
Savings Account #2 (Blacksburg) 
Savings Account #3 (Blacksburg) 
Checking Account (Tallahassee) 
Prepaid Insurance (Expires 4-25-63) 


Total Assets 


28.35 $ 866.43 


33 .50 


$ 2,089.25 


10,397.02 
9 637.50 
3,168.41 
10,875.78 

139.05 
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18,419.36 


$ 2,728.92 


832.93 


$ 3,561.85 


$36 , 307.01 
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Liabilities and Surplus 
Subscriptions to Volume #17 $ 5,993.75 
Subscriptions to Volume #18 182.00 
Subscriptions to Volume #19 42.00 
Subscriptions to Volume #20 7.00 
Surplus from Previous Volumes 26,520.41 
Surplus from Volume #16 3,561.85 
‘Total Liabilities and Surplus $36 ,307 .01 
Comments 


(1) Not included in Assets is stock of back issues from Volumes 1-16. 

(2) Not included in Expenses is printing bill for December reprints of $507.20 

(3) Corrections of surplus from previous volumes results from a reconciliation of 
subscription card files and actual liabilities due to prepaid subscriptions. 


Audited February 17, 1961 
Richard Q. Conrad (Signed) 


Region Belge 
L’ Assemblée Générale annuelle de la Société Adolphe Quetelet s’est tenue a 
Bruxelles, dans la salle du Conseil de la Bibliothéque Royale de Belgique, le 25 
février 1961. Le Conseil d’Administration pour 1961 et 1962 a été constitué comme 
suit: 
Président: Professeur Maurice WELSCH. 
Vice-Présidents: Prof. R. CONSAEL, H. LAUDELOUT, A. LECRENIER, 
J. REUSE et A. VAN DEN HENDE. 
Secrétaire: Dr. L. MARTIN. 
Secrétaire-adjointe: Anne LENGER. 
Trésorier: Pierre GILBERT. 
Membres: Dr. H. G. LION, 
Mme OSLET-CONTER, 
Mr. H. ROGGEN. 


L’Assemblée Générale a été suivie d’une réunion organisée conjointement par 
la Société Quetelet, le Comité belge d’histoire des Sciences et la Société belge de 
Statistiqué Les exposés suivants ont été donnés: 


“Les rapports historiques entre l’anthropologie et la statistique’ par Monsieur 
A. LEGUEBE; 

“La distribution des caractéres anthropométriques’’ par le Professeur C. GINI, 
Président de |’Institut International de Sociologie 4 Rome. 


British Region 
At a meeting held on February 28th, 1961, the following papers were read and 
discussed: 
P. D. Oldham—The Distribution of Arterial Pressure in the General Population. 
L. R. Taylor—A Power Law Transformation for Aggregated Populations. 
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W.N.A.R. 
TREASURER’S REPORT—DECEMBER 31, 1960 
Bernice Brown, Treasurer WNAR 
Receipts 
Balance forwarded from previous treasurer, Dec., 1959 $ 461.22 
Received from 1960 dues (143 @ 7, 10 @ 4) 
1961 dues ( 61 @7, 1 @ 4) 1472.00 
Received for orders of back issues of BIOMETRICS 16.00 
Received from Biometric Society (credit for one institutional 
membership) 10.00 
Received from Biometric Society Treas. (credit for 4 transfers 
from ENAR) 4.00 
Received from ENAR for information circulars 41.60 
Total $2004 . 82 
Expenses 
To Treasurer International (143 @ 6, 10 @ 4) 898 .00 
To BIOMETRICS for back issues ordered by members 16.00 
To Marion Sandomire—mailing expense 11.15 
To printers for stationary and supplies 111.84 
To C. Zippin—partial expense to meeting 26.18 
To W. Becker—mailing expense 12.00 
To ENAR Treasurer—mailing expense 5.00 
To printers for notices of meetings 45.40 
To Pullman Herald for stationary 92.08 
Total $1217 .65 
On hand—checkbook balance $ 787.17 


Total $2004 .82 


| 
| 
| 
= 
3 . 


NEWS AND ANNOUNCEMENTS 


Members are invited to transmit to their National or Regional Secretary (if mem- 
bers at large, to the General Secretary) news of appointments, distinctions, or retirements, 
and announcements of professional interest. 


Robert W. Allard has been granted a Guggenheim Fellowship to study stochastic 
processes in genetics during a six months sabbatical leave to be spent at Oxford 
University in the Biometric Unit beginning February 1, 1961. 

Neeti R. Bohidar has accepted the position of Assistant Professor of Statistics 
in the Department of Applied Statistics, Statistical Laboratory, Utah State Uni- 
versity, Logan, Utah. He received his Ph.D. degree in Statistics from Iowa State 
University in 1960. 

Joseph G. Bryan, formerly Senior Operations Research Analyst at the Central 
Research Laboratory, American Machine and Foundry Co., recently changed 
positions and is now employed by Travelers Weather Research Center, Inc., 11 
Newport Avenue, West Hartford 7, Connecticut. 

William R. Buckland has resigned from London Transport Executive to take 
charge of the new Statistical Advisory Service of The Economist Intelligence Unit 
Ltd., 22, Ryder Street, London, 8.W.1. 

Lyle D. Calvin, Oregon State University, spent the 1960 fall term on sabbatical 
leave with the Department of Statistics, Harvard University. 

Douglas G. Chapman participated in the Fourth Annual Meeting of the North 
Pacific Fur Seal Commission held in Tokyo, January 20 to February 4 as a Scientific 
Advisor to the U. S. Commissioner. The North Pacific Fur Seal Commission is 
composed of representatives from Canada, Japan, U.S.S.R., and the U.S.A. 

Franklin A. Graybill recently left Oklahoma State University to become Profes- 
sor of Mathematical Statistics and Director of the Statistical Laboratory at Colorado 
State University, Fort Collins, Colorado. 

Iowa State University granted Doctor of Philosophy degrees, with major in 
Statistics, to the following people during the Winter Quarter graduation: Roger 
McCullough, Jose Nieto de Pascual, J. N. K. Rao and Thomas Neil Throckmorton. 

Gwilyn Jenkins, after spending a year at Stanford, is now back at his previous 
post as lecturer in Mathematical Statistics, University of London. 

Kuo Hwa Lu, formerly Associate Professor, Department of Statistics, Utah 
State University, has taken the position of Associate Professor of Biostatistics at 
the University of Oregon Dental School, Portland. 

Lincoln E. Moses, Professor of Statistics at Stanford University, is spending a 
year on sabbatical leave at the Department of Social Medicine, Oxford University, 
England. Dr. Moses received a Guggenheim Fellowship. 

Donald B. Siniff had taken a position as Biometrician in the Division of Bio- 
logical Research, Alaska Department of Fish and Game. He previously was at 
North Carolina State College working under the Southeastern Cooperative Wildlife 
Statistics Project. 
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TRAVEL GRANTS FOR ATTENDANCE AT THE INTERNATIONAL 
CONGRESS OF MATHEMATICIANS 


Travel grants will be made to a number of mathematicians who wish to attend 
the International Congress of Mathematicians in Stockholm, on August 15-22, 1962. 
It is hoped that funds available through various sources may provide travel assist- 
ance for a considerable number of mathematicians. 

There will be a greater effort than in the past to give aid to younger people. 
As grants will be made only to those who have filed applications, it is urgent that 
any who wish to receive a grant should fill out and file an application. Younger 
people are urged to file applications so that their cases can be considered. Applica- 
tions can be obtained from the Division of Mathematics, National Academy of 
Sciences, National Research Council, Washington 25, D. C. by requesting an applica- 
tion for a travel grant to the 1962 International Congress. 

The deadline for filing of applications is November 1, 1961, and an attempt 
will be made to announce the grants by January 1, 1962. 

Awarding of grants will be made only to those persons whose applications have 
been received, in good order, by November 1. The selection will be made by a 
committee consisting of the regular Committee on Travel Grants of the Division 
of Mathematics of the National Academy of Sciences—National Research Council 
enlarged to include representatives of societies affiliated with the Division and 
representatives of various governmental agencies. 


TRAINEESHIPS FOR PUBLIC HEALTH STATISTICIANS 


The Public Health Service has announced the availability of traineeships for 
graduate training of professional public health personnel during the 1961-1962 
academic year. 

Traineeships in public health statistics are available to qualified persons. They 
provide stipends from a minimum of $250 per month for a post-bachelor candidate 
to a maximum of $400 per month for a post doctoral candidate and additional 
allowances for dependents, travel of the trainee, and academic tuition and fees. 

Additional information and application forms may be secured from the Division 
of General Health Services, Public Health Service, U. S. Department of Health, 
Education, and Welfare, Washington 25, D. C. 


GRADUATE TRAINEESHIPS IN BIOMETRY 


Training programs designed to prepare students in the application of statistical 
and mathematical methods to biological problems, particularly those related to 
health and medical sciences, now exist in more than 20 universities throughout the 
country. Supported by training grant funds from the Public Health Service, NIH, 
these programs provide unusual opportunities for careers in teaching, research, and 
consultation. Employment opportunities for biometricians are excellent, with the 
demand by governmental and voluntary health agencies, medical research and 
educational institutions, and industry running far in excess of the available supply 
of trained personnel. 

Programs of study are individually designed to lead to doctoral degrees, and in 
special instances, to other academic degrees. Traineeship stipends are provided at 
various levels depending on previous education and experience of the trainee and 
include allowances for dependents. Substantially full economic support or partial 
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support may be provided, depending upon the proportion of time spent in training. 

Interested applicants are encouraged to correspond with one of more of the 
Program Directors listed below because course offerings, as well as specific research 
problems for application of learned skills, vary from school to school. 


Dr. Virgil Anderson 
Purdue University 
Lafayette, Indiana 


Dr. George F. Badger 
Western Reserve University 
Cleveiand 6, Ohio 


Dr. Jacob E. Bearman 
University of Minnesota 
Minneapolis 14, Minnesota 


Dr. Antonio Ciocco 
University of Pittsburgh 
Pittsburgh 13, Pennsylvania 


Dr. Wilfrid J. Dixon 
Medical Center, U.C.L.A. 
Los Angeles 24, California 


Dr. W. T. Federer 
Cornell University 
Ithaca, New York 


Dr. John W. Fertig 
Columbia University 
New York 32, New York 


Dr. Franklin A. Graybill 
Colorado State University 
Fort Collins, Colorado 


Dr. Bernard G. Greenberg 
University of North Carolina 
Chapel Hill, North Carolina 


Drs. John Gurland and T. A. Bancroft 
Iowa State University 
Ames, Iowa 


Dr. Boyd Harshbarger 
Virginia Polytechnic Institutc 
Blacksburg, Virginia 


Dr. Allyn Kimball 
Johns Hopkins University 
Baltimore 5, Maryland 


Dr. Schuyler G. Kohl 
State Univ. of N. Y., Col. of Med. 
Brooklyn 3, New York 


Dr. Robert F. Lewis 
Tulane University 
New Orleans 12, Louisiana 


Dr. Eugene Lukacs 
The Catholic University of America 
Washington, D. C. 


Dr. Paul Meier 
University of Chicago 
Chicage 37, Illinois 


Prof. Felix Moore 
University of Michigan 
Ann Arbor, Michigan 


Dr. Lincoln E. Moses 
Stanford Medical School 
Stanford, California 


Dr. Hugo Muench 
Harvard School of Public Health 
Boston 15, Massachusetts 


Dr. Robert Quinn 
Vanderbilt University 
Nashville 5, Tennessee 


Prof. J. A. Rigney 
North Carolina State College 
Raleigh, North Carolina 


Drs. W. W. Schottstaedt and James Hagans 
University of Oklahoma 
Oklahoma City 4, Oklahoma 


Dr. Malcolm E. Turner, Jr. 
Medical College of Virginia 
Richmond, Virginia 


Dr. Colin White 
Yale School of Medicine 
New Haven, Connecticut 


Dr. J. Yerushalmy 
University of California 
Berkeley 4, California 
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For those unable to train during the academic year, an unusual opportunity 
is provided by a cooperative GRADUATE SESSION OF STATISTICS IN THE 
HEALTH SCIENCES sponsored by these Program Directors and made possible 
by a training grant from the PHS, NIH. For information concerning available 
stipends and course offerings at elementary, intermediate, or advanced levels for 


the summers of 1961 and 1962, write Dr. Jacob E. Bearman, University of Minnesota, 
Minneapolis, Minnesota. 


FELLOWSHIPS FOR MATHEMATICS GRADUATES 


The Division of Preventive Medicine and the Institute of Industrial Health of 
the College of Medicine, The University of Cincinnati, with the support of the 
Public Health Service, are instituting a training program in Epidemiology and 
Biostatistics. As part of this program training and experience will be given in 
biology and research to bright, young, and prospective candidates for a Ph.D. 
degree in Mathematics or Statistics. The prospective fellow should have his B.A. 
or B.S. in Mathematics. He should have decided on a department at which he 
will want to complete his graduate work. Above all he must have demonstrated a 
level of achievement that will make him an acceptable candidate for an advanced 
degree at any university. 

The student will be exposed also to research projects; working with medical 
and other fellows in this program and in the Institute of Industrial Health. He will 
be expected to write a publishable paper in some aspects of Mathematical Biology 
at the end of his two year stay. Arrangements may also be made for him to take 
additional work or gain additional research experience at another institution. The 
candidate will receive invaluable experience for a future career in the area of Biology 
or Mathematics and Statistics. The stipend will depend on qualifications and 
marital status and will range from $3400 to $4400 plus tuition. 

For further information write to Dr. Theodor D. Sterling, Department of 


Preventive Medicine, College of Medicine, University of Cincinnati, Cincinnati, 
Ohio. 


ON-THE-JOB TRAINEE APPOINTMENTS 


The Department of Statistics at Roswell Park Memorial Institute has been 
awarded a grant by the National Cancer Institute and in conjunction with the 
University of Buffalo offers a two-year graduate on-the-job training program leading 
to « Master of Science degree in biostatistics. 

Students with a Bachelor’s degree, and possessing a good background in mathe- 
matics (through calculus), and course work in physical, biological or behavioral 
sciences who will begin their graduate work next fall are sought as applicants for 
these appointments. In addition to taking graduate course work, trainees will 
receive on-the-job training in research studies that are currently in progress at 
Roswell Park Memorial Institute. Trainees will receive an average annual stipend 
of $2300.00 plus tuition. 

Requests for further information and application forms should be addressed to 
Miss Barbara A. Cote, c/o Dr. Irwin D. J. Bross, Chief, Department of Statistics, 
Roswell Park Memorial Institute, 666 Elm Street. Buffalo 3, New York. 
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BIOMETRIE—PRAXIMETRIE 


Tome I, N° 3-4 Juillet-Octobre, 1960 


Editorial 


Utilisation de calculateurs électroniques dans l’analyse d’expériences avec 
répétitions et de groupes d’expériences de méme plan expérimental .F. Yates 


Planification des expériences d’alimentation des vaches laitiéres. ..H.L. Lucas 
La sélection artificielle suivant des caractéres quantitatifs... . . H. L. Le Roy 


La répartition des sexes chez des cucurbitac¢es hybrides et 1 leur relation 
avec une distribution contagieuse de Neyman................. F. WEILING 


La puissance du critére F dans l’analyse de la variance de plans en blocs au 
hasard, nomogrammes pour le choix du nombre de répétitions. ...M. Keu.s 


Développement des méthodes biométriques et statistiques dans la recherche 
agronomique au Congo Belge et au Ruanda-Urundi.......... J.-M. HENRY 


Développement des méthodes biométriques et statistiques dans la recherche 


L’emploi des méthodes biométriques dans I’étude ef l’expérimentation des 
variétés de betterave sucriére en Belgique... .M. Srmon et N. Rousse. 


Les méthodes d’échantillonnage en sylviculture............. ANNE LENGER 


Radiosensibilité des graines d’andropogon issues de terrains uraniféres et non- 
uraniféres du Katanga...... Dr. J. MewisseNn, J. DamBLon, ET Z. M. Bacg 


Dix années d’activités de la Biometric Society en Belgique, au Congo Belge 
et au Ruanda-Urundi 


Revue bibliographique. 


Tome II, N° 1 : Mars, 1961 


Quelques problémes de numérations bactériennes H. Grimm 


Comparaison de deux méthodes d’analyse de données non orthogonales dans 
le cas d’expériences 4 deux facteurs. ..... P. GILBERT ET B. GROSSMANN 
Analyse de données non orthogonales dans le cas d’une expériences 4 deux 
Revue bibliographique: D. J. Finney: Experimental Design and its Statistical 


Publishers for the 


SOCIETE ADOLPHE QUETELET 
7 rue Héger-Bordet, Brussels 1, Belgium 


Presses Universitaires de Bruxelles 
50, av. Franklin Roosevelt 
Brussels 
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AMERICAN STATISTICAL 
ASSOCIATION 


Volume 56 June 1961 Number 294 


TABLE OF CONTENTS 


Confidence Curves: An Omnibus Technique for Estimation and 


Testing Statistical Hypotheses ..............ecceeeees ALLAN BIRNBAUM 
Changes in the Size Distribution of Dividend Income ...... Epwin B. Cox 
Note on Curve Fitting with Minimum Deviations by Linear 

Bivariate Logistic Distributions .................c00eeeeeee: E. J. GUMBEL 
Partial Correlations in Regression Computations ....Ropert L. Gustarson 


An Analysis of Consistency of Response in Household Surveys 

Caro. M. JAEGER AND JEAN L. PENNOCK 
Multiple Regression Analysis of a Poisson Process ....DALE W. JorcENSON 
Factorial Treatments in Rectangular Lattice Designs 

Y. KraMer AND Leroy S. BRENNA 


Significance Tests in Discrete Distributions .............. H. O. Lancaster 
Exact and Approximate Distributions for the Wilcoxon Statistic 


The Use of Sample Quasi-Ranges in Setting Confidence Intervals for the 
Population Standard Deviation 


Frep C. Leone, C. W. Torr, ano Y. H. RuTENBERG 
Randomized Rounded-Off Multipliers in Sampling Theory 
M.N. Murtny anp V. K. Serui 
Unbiased Componentwise Ratio Estimation 
D.S. Rosson anp Cuitra VITHAYASAL 
A Note on Measurement Errors and Detecting Real 
Differences 
A Quarterly Econometric Model of the United States 
E. GALLAwAy AND SmitH 
On the Use of Partially Ordered Observations in Measuring 
the Support for a Complete Order R. F. Tate 
The Statistical Work of Oskar Anderson 
A Problem Concerned with Weighting of 


For further information, please contact: 


AMERICAN STATISTICAL ASSOCIATION 
1757 K Street, N.W., Washington 6, D. C. 
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TECHNOMETRICS 
A Journal of Statistics for the 
Physical, Chemical and Engineering Sciences 


Vol. 3, No. 1 February, 1961 


CONTENTS 
Average Run Lengths in Cumulative Chart Quality Control Schemes 
P. L. GotpsMITH AND H. WHITFIELD 
Prediction Regions for Several Predictions from a Single Regression Line 
GERALD J. LIEBERMAN 
The Robustness of Certain Life Testing Procedures Derived from the 
Exponential Distribution...... Marvin ZELEN AND Mary C. DANNEMILLER 
An Application of a Balanced Incomplete Block Design..PeTer W. M. JoHN 
Multi-component Systems and Structures and Their Reliability 
Z. W. Birnsaum, J. D. Esary ann S. C. SaunDERS 
An Asymptotic Distribution for an Occupancy Problem with Statistical 
M. Hatperin G. L. Burrows 
Outliers in Patterned Experiments: A Strategic Appraisal 
Irwin D. J. Bross 


Acueson J. DuNCAN AND WILLIAM BerANEK 

Statistical Programs for High Speed Computers 

Notices 

Vol. 3, No. 2 May, 1961 
CONTENTS 

General Considerations in the Analysis of Spectra.......... G. M. JENKINS 


Mathematical Considerations in the Estimation of Spectra 
EMANUEL ParzEN 
Discussion, Emphasizing the Connection Between Analysis of Variance and 
Some Comments on Spectral Analysis of Time Series...... N. R. GoopMan 
Comments on the Discussions of Messrs. Tukey and Goodman 
G. M. Jenkins anp EMANUEL ParzEN 
Spectral Analysis Combining a Bartlett Window with an Associated Inner 
Frequency Response from Stationary Noise: Two Case Histories 
N. R. Goopman, 8S. Katz, B. H. Kramer anp M. T. Kuo 
The Modified Gauss-Newton Method for the Fitting of Non-Linear Regres- 


sion Functions by Least Squares. H. O. Hartiey 
On the Possibility of Improving the Mean Useful Life of Items by Elimi- 
nating Those with Short Lives.......... G.S. Watson anp W. R. WELLS 


The Optimum Allocation of Spare Components in System 
Donatp F.. Morrison 
Use of Tables of Percentage Points of Range and Studentized Range 


H. Leon Harter 
Statistical Programs for High Speed Computers 
Notices 


Technometrics is published quarterly in February, May, August, and 
November. The annual non-member subscription rate is $8.00. To members 
of the American Statistical Association and the American Society for Quality 
Control the rate is $6.00. Checks should be made payable to Technometrics 
and addressed to Technometrics, Post Office Box 587, Benjamin Franklin 
Station, Washington 6, D. C. 
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INTERNATIONAL JOURNAL OF ABSTRACTS 
STATISTICAL THEORY AND METHOD 


A Journal of the International Statistical Institute 


The aim of this journal of abstracts is to give complete coverage 
of published papers in the field of statistical theory (including 
associated aspects of probability and other mathematical methods) 
and new published contributions to statistical method. 


All contributions in the following five journals—being wholly 
devoted to this field—are abstracted: Annals of Mathematical 
Statistics; Biometrika; Journal, Royal Statistical Society (Series 
B); Bulletin of Mathematical Statistics; Annals, Institute of Sta- 
tistical Mathematics; and a further group of six journals are ab- 
stracted on a virtually complete basis as follows: Biometrics; 
Metrika; Metron; Review, International Statistical Institute; 
Technometrics; Sankhyé. There are about 250 other journals 
partly devoted to statistical theory and method from which the 
appropriate papers are abstracted. 


The abstracts are about 400 words long—the recommendation 
of UNESCO for the “long” abstract service: they are in the Eng- 
lish language although the original language of the paper is 
noted on the abstract together with the name of abstractor. In 
addition to the address of the author(s) are given in detail to 
facilitate contact in order to obtain further detail or request an 
off-print. The journal is published quarterly and contains ap- 
proximately 1000 abstracts per year. 


A scheme of classification has been developed for the abstracts 
that is flexible and facilitates the transfer of code numbers to 
punched cards. A unique aspect of this journal is that the pages 
are colour-tinted according to the main sections of classification. 
This method of colour-coding the pages provides a distinctive 
and powerful visual aid in the identification of abstracts in what- 
ever manner the journal is filed for reference. 


Annual Subscription £5 (U.S.A. and Canada $16.00) 
Single Number 30s (U.S.A. and Canada $4.50) 


OLIVER AND BOYD LTD. 
Tweeddale Court, 14 High Street, Edinburg, 1 
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INFORMATION FOR CONTRIBUTORS 


MANUSCRIPTS 


Contributions for Biometrics may be addressed to Dr. Ralph A. Bradley, De- 
partment of Statistics, The Florida State University, Tallahassee, Florida, US.A.; 
authors residing in the following Society Regions can expedite consideration of pa- 
pers by submitting them to the appropriate Associate Editor, namely; BRITISH 
REGION: Dr. S. C. Pearce, East Malling Research Station, East Malling, Maid- 
stone, Kent, England; AUSTRALASIAN REGION: Dr. E. A. Cornish, Univer- 
sity of Adelaide, Adelaide, Australia; FRENCH REGION: Dr. Georges Teissier, 
Faculté des Sciences de Paris, 1 rue V. Cousin, Paris, France. QUERIES, NOTES, 
and related correspondence should be directed to Dr. D. J. Finney, Department of 
Statistics, University of Aberdeen, Meston Walk, Old Aberdeen, Scotland. Books 
and material for Book Reviews should be sent to Mr. J. G. Skellam, The Nature 
Conservancy, 19 Belgrave Square, London, S.W. 1, England. 

MANUSCRIPTS must be submitted in triplicate, with typescript doublespaced 
throughout. Marginal notes may obviate typographical difficulties presented for 
complicated formulae or tables—authors should not attempt editorial instructions 
or markings for the printer. TABLES should be identified by arabic number and 
by a short descriptive title. ILLUSTRATIONS should also be identified by arabic 
number and by a brief caption. (Captions should not be included in illustrations, 
but should be typewritten collectively on an accompanying sheet.) Originals 
should be approximately 8.5 x 11 in. (21.5 x 28 cm.). The original of each chart, 
diagram, or graph should be executed in black on white drawing paper or board, 
on blue tracing linen, or on coordinate paper ruled in blue only; coordinate lines 
to be reproduced should be ruled in black. For printing, illustrations may be re- 
duced to % or % original dimensions. Lines should therefore be of sufficient thick- 
ness, and decimal points, periods, and stippled dots should be solid black circles 
large enough to reproduce well. Lettering and numerals should be at least 1 mm. 
high when reproduced in a cut 3 in. (7.5 cm.) wide. Photographs should be prints 
on gloss paper with strong contrasts, and if grouped in a plate should be mounted 
contiguously. All tables and illustrations should be mentioned explicitly in the 
text. REFERENCES (BIBLIOGRAPHIC) should be collectively listed alpha- 
betically by author; textual citation by author and year is preferred. 


ABSTRACTS 

Abstracts of papers presented at meetings of the Biometric Society or of its 
regions are printed in Biometrics following such meetings. They should be sub- 
mitted to the person designated to receive them for a particular meeting in exactly 
the form published in Biometrics (except for an Abstract Number), doublespaced 
on bond paper, and in duplicate. Use of formulae requiring display printing is to 
be avoided. 

Notices, ANNOUNCEMENTS, AND Biometaic Society Reports 

International and regional reports and notices should be submitted by the 
appropriate officers of the Society and its Regions in duplicate doublespaced on 
separate sheets exactly as they are to be printed in Biometrics. Other material to 
be printed in News and Announcements should also be submitted doublespaced 
and in duplicate. 


Sustarninc MeMBERS OF THE BioMETRric SocreTy 
Abbott Laboratories 
American Cancer Society, Inc. 
General Foods Corporation, Research Center 
Merck, Sharp and Dohme Research Laboratories 
Schering Corporation 
Smith, Kline and French Laboratories 
E. R. Squibb and Sons 
The Upjohn Company 
Wallace Laboratories, Division of Carter Products. 
Wyeth Institute of Applied Biochemistry 
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BACK ISSUES 


Back issues of Biometrics are available at the following postage-paid 
prices in U.S.A. currency: 


Price per Price per 
Year Volume Number Single Number Volume (unbound) 


1 to6 
1 to 6 
1 to4 
lto4 
1to4 
1lto4 
lto4 
lto4 
lto4 
lto4 
lto4 
lto4 . 
lto4 
1to4 
1lto4 
lto4 


Reprints of individual articles are not available except to authors at the 
time of printing. Three special issues are among the numbers listed 
above. They are: 


1947 Volume 3 Number 1 The Analysis of Variance 
1951 Volume 7 + #Numberl Components of Variance 
1957 Volume 13 Number 3 The Analysis of Covariance 


Also available are: 

Fishery Reprint Series (Selected reprints from Vol. 5) $1.00 
Subject Index (Volumes 1-10) 1.00 
Proceedings, International Biometric Symposium, 
Campinas, Brazil, 1955. 1.00 
Inquiries, non-member subscriptions, and orders for back issues and 
other material listed above should be addressed to: Biometrics, Depart- 
MENT OF Statistics, THE State University, TALLAHASSER, 
Frorma, U.S.A. 
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